Sep 17 18:36:52.483767 ip-10-0-136-140 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 18:36:52.483778 ip-10-0-136-140 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 18:36:52.483787 ip-10-0-136-140 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 18:36:52.483987 ip-10-0-136-140 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 18:37:02.567872 ip-10-0-136-140 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 18:37:02.567889 ip-10-0-136-140 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 30da8ff4df1744ae9fb584f04c852927 -- Sep 17 18:39:02.281009 ip-10-0-136-140 systemd[1]: Starting Kubernetes Kubelet... Sep 17 18:39:05.766328 ip-10-0-136-140 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:39:05.766328 ip-10-0-136-140 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 18:39:05.766328 ip-10-0-136-140 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:39:05.766328 ip-10-0-136-140 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 18:39:05.766328 ip-10-0-136-140 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:39:05.767156 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.766403 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 18:39:05.770593 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770578 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:39:05.770593 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770593 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770597 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770601 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770606 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770610 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770613 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770616 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770620 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770623 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770626 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770629 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770631 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770634 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:39:05.770657 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770650 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770669 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770674 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770678 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770682 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770687 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770690 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770693 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770695 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770698 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770702 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770706 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770709 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770711 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770714 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770717 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770719 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770722 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770724 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:39:05.770987 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770726 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770729 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770732 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770734 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770736 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770739 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770742 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770756 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770759 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770762 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770765 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770767 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770770 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770772 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770775 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770780 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770784 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770787 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770790 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:39:05.771445 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770793 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770796 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770799 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770801 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770804 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770807 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770810 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770813 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770816 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770818 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770821 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770823 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770826 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770828 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770831 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770833 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770837 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770839 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770842 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770850 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:39:05.771917 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770853 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770856 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770858 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770861 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770863 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770866 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770868 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770871 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770875 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770878 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770880 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770883 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770885 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770888 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770891 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770894 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770896 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770899 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770902 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:39:05.772398 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770905 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770907 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770910 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770912 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770915 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770918 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770920 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.770923 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771613 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771619 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771622 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771625 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771627 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771630 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771633 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771636 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771638 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771642 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771644 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771647 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:39:05.772940 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771650 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771654 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771657 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771660 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771662 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771665 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771668 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771670 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771673 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771676 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771678 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771681 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771683 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771686 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771688 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771691 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771694 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771697 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771699 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771702 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:39:05.773433 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771704 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771707 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771709 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771711 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771714 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771716 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771719 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771722 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771725 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771727 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771729 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771732 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771734 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771738 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771742 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771759 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771762 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771764 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771767 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771770 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:39:05.773944 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771772 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771775 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771780 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771784 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771787 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771790 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771793 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771795 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771798 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771800 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771803 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771805 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771808 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771810 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771813 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771815 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771818 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771820 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771823 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:39:05.774426 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771826 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771829 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771834 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771838 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771841 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771844 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771848 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771850 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771853 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771855 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771858 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771860 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771863 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771865 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771868 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771870 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771873 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771875 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771878 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:39:05.774905 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771881 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771883 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771886 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771888 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771892 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771896 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771899 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771902 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.771904 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772272 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772277 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772281 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772284 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772287 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772290 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772292 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772297 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772300 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772303 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:39:05.775371 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772307 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772310 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772313 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772316 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772319 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772321 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772324 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772326 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772329 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772332 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772334 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772336 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772339 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772341 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772344 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772346 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772348 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772351 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772353 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772356 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:39:05.775850 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772358 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772361 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772363 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772366 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772369 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772373 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772376 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772384 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772386 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772389 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772392 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772395 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772399 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772402 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772405 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772408 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772410 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772413 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772415 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:39:05.776343 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772418 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772421 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772424 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772426 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772429 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772431 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772434 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772437 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772439 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772444 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772448 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772450 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772453 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772456 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772458 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772461 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772463 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772465 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772468 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772471 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:39:05.776821 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772473 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772476 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772478 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772481 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772483 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772486 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772489 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772491 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772494 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772497 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772499 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772502 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772504 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772507 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772509 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772512 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772514 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772516 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772519 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772521 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:39:05.777341 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772524 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772528 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772530 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772533 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772536 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772538 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772541 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772543 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772546 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.772548 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772666 2552 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772710 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772721 2552 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772726 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772735 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772739 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772756 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772760 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772764 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772767 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772771 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772774 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 18:39:05.777891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772778 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772781 2552 flags.go:64] FLAG: --cgroup-root="" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772784 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772787 2552 flags.go:64] FLAG: --client-ca-file="" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772789 2552 flags.go:64] FLAG: --cloud-provider="external" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772792 2552 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772800 2552 flags.go:64] FLAG: --cluster-domain="" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772803 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772806 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772809 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772812 2552 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772817 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772821 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772824 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772827 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772830 2552 flags.go:64] FLAG: --contention-profiling="false" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772833 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772836 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772839 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772842 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772846 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772849 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772852 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772855 2552 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772858 2552 flags.go:64] FLAG: --enable-server="true" Sep 17 18:39:05.778430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772862 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772867 2552 flags.go:64] FLAG: --event-burst="100" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772872 2552 flags.go:64] FLAG: --event-qps="50" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772875 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772878 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772881 2552 flags.go:64] FLAG: --eviction-hard="" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772884 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772887 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772890 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772893 2552 flags.go:64] FLAG: --eviction-soft="" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772896 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772898 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772901 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772904 2552 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772907 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772909 2552 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772912 2552 flags.go:64] FLAG: --feature-gates="" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772916 2552 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772921 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772924 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772927 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772930 2552 flags.go:64] FLAG: --healthz-port="10248" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772933 2552 flags.go:64] FLAG: --help="false" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772936 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-136-140.ec2.internal" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772939 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 18:39:05.779033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772942 2552 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772945 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772948 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772952 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772955 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772958 2552 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772960 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772963 2552 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772966 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772971 2552 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772973 2552 flags.go:64] FLAG: --kube-reserved="" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772977 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772979 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772982 2552 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772985 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772988 2552 flags.go:64] FLAG: --lock-file="" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772991 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772994 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.772996 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773001 2552 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773004 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773007 2552 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773010 2552 flags.go:64] FLAG: --logging-format="text" Sep 17 18:39:05.779675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773013 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773016 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773019 2552 flags.go:64] FLAG: --manifest-url="" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773022 2552 flags.go:64] FLAG: --manifest-url-header="" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773031 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773034 2552 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773037 2552 flags.go:64] FLAG: --max-pods="110" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773040 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773043 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773046 2552 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773049 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773052 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773054 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773057 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773064 2552 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773067 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773070 2552 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773073 2552 flags.go:64] FLAG: --pod-cidr="" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773078 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773083 2552 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773086 2552 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773089 2552 flags.go:64] FLAG: --pods-per-core="0" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773092 2552 flags.go:64] FLAG: --port="10250" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773095 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 18:39:05.780304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773098 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0669e6e8696a0fe88" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773101 2552 flags.go:64] FLAG: --qos-reserved="" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773103 2552 flags.go:64] FLAG: --read-only-port="10255" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773106 2552 flags.go:64] FLAG: --register-node="true" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773109 2552 flags.go:64] FLAG: --register-with-taints="" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773112 2552 flags.go:64] FLAG: --registry-burst="10" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773115 2552 flags.go:64] FLAG: --registry-qps="5" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773118 2552 flags.go:64] FLAG: --reserved-cpus="" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773121 2552 flags.go:64] FLAG: --reserved-memory="" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773124 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773128 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773131 2552 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773133 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773136 2552 flags.go:64] FLAG: --runonce="false" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773139 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773143 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773145 2552 flags.go:64] FLAG: --seccomp-default="false" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773148 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773151 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773154 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773157 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773160 2552 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773163 2552 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773166 2552 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773169 2552 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773172 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 18:39:05.780923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773175 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773180 2552 flags.go:64] FLAG: --system-cgroups="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773183 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773188 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773191 2552 flags.go:64] FLAG: --tls-cert-file="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773194 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773198 2552 flags.go:64] FLAG: --tls-min-version="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773200 2552 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773203 2552 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773206 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773209 2552 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773212 2552 flags.go:64] FLAG: --v="2" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773215 2552 flags.go:64] FLAG: --version="false" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773220 2552 flags.go:64] FLAG: --vmodule="" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773223 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.773227 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773335 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773340 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773343 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773346 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773348 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773351 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773354 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:39:05.781589 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773358 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773362 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773365 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773367 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773370 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773372 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773376 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773380 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773384 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773388 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773392 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773396 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773398 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773401 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773404 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773406 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773409 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773412 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773415 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773417 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:39:05.782168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773420 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773422 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773425 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773428 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773430 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773433 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773436 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773439 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773442 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773445 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773448 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773452 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773455 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773458 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773461 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773464 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773467 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773470 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773472 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773475 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:39:05.782660 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773478 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773481 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773485 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773488 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773491 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773494 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773496 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773499 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773502 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773504 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773507 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773510 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773512 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773515 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773518 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773520 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773523 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773527 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773530 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:39:05.783176 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773532 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773535 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773538 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773541 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773543 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773546 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773549 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773551 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773554 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773556 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773560 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773563 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773567 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773570 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773573 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773578 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773581 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773584 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773587 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:39:05.783633 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773590 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773593 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773596 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773599 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773601 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773604 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773607 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773610 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773613 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773615 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773618 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773623 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773626 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.773629 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.774243 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:39:05.784114 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781069 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781082 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781101 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781106 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781161 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781166 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781170 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781173 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781176 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781179 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781182 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781185 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781188 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781191 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781194 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781197 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781201 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781204 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781207 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:39:05.784519 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781209 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781212 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781215 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781218 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781220 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781223 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781226 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781229 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781231 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781234 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781237 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781239 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781242 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781244 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781248 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781251 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781254 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781256 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781259 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781262 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:39:05.785004 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781264 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781268 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781272 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781275 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781277 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781280 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781283 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781285 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781288 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781291 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781295 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781298 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781301 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781304 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781307 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781309 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781312 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781315 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781318 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781320 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:39:05.785487 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781323 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781325 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781328 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781332 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781336 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781339 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781343 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781346 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781349 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781351 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781354 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781357 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781360 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781362 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781365 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781368 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781370 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781373 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781376 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:39:05.785997 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781378 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781381 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781384 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781387 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781390 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781393 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781396 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781399 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781402 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781404 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781407 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781410 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781413 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781415 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781418 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781420 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781423 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781426 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781428 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781431 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:39:05.786453 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781433 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781436 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781439 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781442 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781444 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781450 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781553 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781558 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781561 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781564 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781567 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781570 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781573 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781576 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:39:05.786964 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781578 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781581 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781584 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781588 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781592 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781596 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781599 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781603 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781606 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781609 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781612 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781615 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781618 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781621 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781624 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781626 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781629 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781632 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781634 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781637 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:39:05.787304 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781640 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781643 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781646 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781649 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781652 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781654 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781657 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781661 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781664 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781668 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781670 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781673 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781676 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781680 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781683 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781685 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781689 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781692 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781695 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:39:05.787806 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781698 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781701 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781704 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781707 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781710 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781713 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781716 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781718 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781721 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781724 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781727 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781729 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781732 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781734 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781737 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781740 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781742 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781758 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781761 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781764 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:39:05.788281 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781767 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781770 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781772 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781775 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781777 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781780 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781784 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781788 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781791 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781793 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781797 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781799 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781802 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781804 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781807 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781809 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781812 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781815 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781817 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:39:05.788785 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781820 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781822 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781825 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781827 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781830 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781832 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781835 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781837 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781840 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781843 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781845 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781848 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:05.781850 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781855 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.781944 2552 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 18:39:05.789443 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.783729 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 18:39:05.789851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.784614 2552 server.go:1019] "Starting client certificate rotation" Sep 17 18:39:05.789851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.784706 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 18:39:05.789851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.784736 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 18:39:05.789851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.787027 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 18:39:05.793899 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.793876 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 18:39:05.797592 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.797573 2552 log.go:25] "Validated CRI v1 runtime API" Sep 17 18:39:05.800262 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.800245 2552 log.go:25] "Validated CRI v1 image API" Sep 17 18:39:05.801136 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.801106 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 18:39:05.804632 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.804613 2552 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9ad8d08b-ac42-4afd-aa5a-12c4f99a65f2:/dev/nvme0n1p4 b9834298-a7d4-493a-9b67-5cdab4738f6f:/dev/nvme0n1p3] Sep 17 18:39:05.804701 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.804635 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 18:39:05.809521 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.809415 2552 manager.go:216] Machine: {Timestamp:2026-09-17 18:39:05.808939108 +0000 UTC m=+2.041513129 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102303 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a5dea4dbf1abc56c412fc5886741 SystemUUID:ec21a5de-a4db-f1ab-c56c-412fc5886741 BootID:30da8ff4-df17-44ae-9fb5-84f04c852927 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ef:61:4c:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ef:61:4c:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:60:71:8b:bc:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 18:39:05.809521 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.809513 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 18:39:05.809628 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.809607 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 18:39:05.811091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.811065 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 18:39:05.811217 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.811096 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 18:39:05.812290 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.812280 2552 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 18:39:05.812327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.812294 2552 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 18:39:05.812327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.812301 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 18:39:05.812327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.812311 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 18:39:05.812405 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.812376 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 18:39:05.815139 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.815128 2552 state_mem.go:36] "Initialized new in-memory state store" Sep 17 18:39:05.815243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.815234 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 18:39:05.820884 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.820864 2552 kubelet.go:486] "Attempting to sync node with API server" Sep 17 18:39:05.820884 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.820888 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 18:39:05.821032 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.820909 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 18:39:05.821032 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.820934 2552 kubelet.go:398] "Adding apiserver pod source" Sep 17 18:39:05.821032 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.820946 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 18:39:05.821293 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.821280 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 18:39:05.821353 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.821303 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 18:39:05.822988 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.822973 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 18:39:05.823143 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.823132 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 18:39:05.825048 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.825034 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 18:39:05.825107 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.825065 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 18:39:05.826189 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826178 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 18:39:05.826224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826198 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 18:39:05.826224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826206 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 18:39:05.826224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826211 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 18:39:05.826224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826220 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 18:39:05.826224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826226 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826239 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826245 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826253 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826262 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826274 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826279 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826311 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 18:39:05.826350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.826320 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 18:39:05.829899 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.829886 2552 server.go:1268] "Started kubelet" Sep 17 18:39:05.830038 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.829976 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 18:39:05.830078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.830056 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 18:39:05.830687 ip-10-0-136-140 systemd[1]: Started Kubernetes Kubelet. Sep 17 18:39:05.867064 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.867026 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 18:39:05.867151 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.867110 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 18:39:05.867417 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.867397 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 18:39:05.867596 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.867571 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 18:39:05.867995 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.867961 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 18:39:05.868500 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.868480 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcchd" Sep 17 18:39:05.868500 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.868499 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcchd" Sep 17 18:39:05.869061 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.869038 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 18:39:05.869362 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.869344 2552 server.go:310] "Adding debug handlers to kubelet server" Sep 17 18:39:05.871843 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.870966 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-140.ec2.internal.18d62fb28c3d4e28 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-140.ec2.internal,UID:ip-10-0-136-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-140.ec2.internal,},FirstTimestamp:2026-09-17 18:39:05.829862952 +0000 UTC m=+2.062436968,LastTimestamp:2026-09-17 18:39:05.829862952 +0000 UTC m=+2.062436968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-140.ec2.internal,}" Sep 17 18:39:05.874915 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.874896 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 18:39:05.874915 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.874910 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 18:39:05.875129 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.875110 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:05.875517 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875498 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 18:39:05.875624 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875503 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 18:39:05.875624 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875624 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 18:39:05.875773 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875649 2552 factory.go:55] Registering systemd factory Sep 17 18:39:05.875773 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875664 2552 factory.go:223] Registration of the systemd container factory successfully Sep 17 18:39:05.875773 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875765 2552 reconstruct.go:97] "Volume reconstruction finished" Sep 17 18:39:05.875773 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875774 2552 reconciler.go:29] "Reconciler: start to sync state" Sep 17 18:39:05.875926 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875878 2552 factory.go:153] Registering CRI-O factory Sep 17 18:39:05.875926 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875892 2552 factory.go:223] Registration of the crio container factory successfully Sep 17 18:39:05.876002 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875941 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 18:39:05.876002 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875959 2552 factory.go:103] Registering Raw factory Sep 17 18:39:05.876002 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.875973 2552 manager.go:1196] Started watching for new ooms in manager Sep 17 18:39:05.876630 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.876591 2552 manager.go:349] Starting recovery of all containers Sep 17 18:39:05.876939 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.876908 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 18:39:05.877023 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.877003 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 18:39:05.885607 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.885594 2552 manager.go:354] Recovery completed Sep 17 18:39:05.889686 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.889670 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:05.892323 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892305 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:05.892389 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892337 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:05.892389 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892350 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:05.892902 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892885 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 18:39:05.892902 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892901 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 18:39:05.893024 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892920 2552 state_mem.go:36] "Initialized new in-memory state store" Sep 17 18:39:05.893024 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.892904 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:05.893643 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.893629 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:05.893694 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.893655 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:05.893694 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.893665 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:05.894653 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.894643 2552 policy_none.go:49] "None policy: Start" Sep 17 18:39:05.894687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.894660 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 18:39:05.894687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.894670 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 18:39:05.895726 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.895715 2552 policy_none.go:47] "Start" Sep 17 18:39:05.936438 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936320 2552 manager.go:337] "Starting Device Plugin manager" Sep 17 18:39:05.936579 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.936459 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 18:39:05.936579 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936469 2552 server.go:87] "Starting device plugin registration server" Sep 17 18:39:05.936679 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936650 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 18:39:05.936713 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936674 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 18:39:05.936785 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936769 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 18:39:05.936873 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936855 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 18:39:05.936873 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.936870 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 18:39:05.937476 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.937459 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 18:39:05.937553 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.937498 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:05.970835 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.970805 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 18:39:05.971948 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.971931 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 18:39:05.972035 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.971973 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 18:39:05.972035 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.971989 2552 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 18:39:05.972035 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:05.972020 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 18:39:05.974365 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:05.974346 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:06.037321 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.037272 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:06.038079 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.038064 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:06.038150 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.038116 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:06.038150 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.038127 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:06.038150 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.038145 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.044071 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.044058 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.044156 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.044077 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-140.ec2.internal\": node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.067954 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.067936 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.072942 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.072926 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"] Sep 17 18:39:06.072990 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.072981 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:06.074253 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.074238 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:06.074326 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.074265 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:06.074326 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.074275 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:06.075239 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.075221 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:06.075346 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.075332 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.075393 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.075359 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:06.076308 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076289 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:06.076401 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076319 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:06.076401 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076321 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0160a3929891b136e3cfbbb46a2b3ba2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"0160a3929891b136e3cfbbb46a2b3ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.076401 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076332 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:06.076401 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076345 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0160a3929891b136e3cfbbb46a2b3ba2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"0160a3929891b136e3cfbbb46a2b3ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.076401 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16feb325486f0987d2add9b4aa5c9287-config\") pod \"kube-apiserver-proxy-ip-10-0-136-140.ec2.internal\" (UID: \"16feb325486f0987d2add9b4aa5c9287\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.076401 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076294 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:06.077186 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076414 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:06.077186 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.076430 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:06.078093 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.078078 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.078183 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.078103 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:39:06.078832 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.078813 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:39:06.078896 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.078845 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:39:06.078896 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.078859 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:39:06.101365 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.101345 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-140.ec2.internal\" not found" node="ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.105595 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.105580 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-140.ec2.internal\" not found" node="ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.168069 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.168050 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.176659 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.176631 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0160a3929891b136e3cfbbb46a2b3ba2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"0160a3929891b136e3cfbbb46a2b3ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.176727 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.176668 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0160a3929891b136e3cfbbb46a2b3ba2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"0160a3929891b136e3cfbbb46a2b3ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.176727 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.176684 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16feb325486f0987d2add9b4aa5c9287-config\") pod \"kube-apiserver-proxy-ip-10-0-136-140.ec2.internal\" (UID: \"16feb325486f0987d2add9b4aa5c9287\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.176727 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.176707 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0160a3929891b136e3cfbbb46a2b3ba2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"0160a3929891b136e3cfbbb46a2b3ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.176866 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.176741 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0160a3929891b136e3cfbbb46a2b3ba2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"0160a3929891b136e3cfbbb46a2b3ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.176866 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.176741 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16feb325486f0987d2add9b4aa5c9287-config\") pod \"kube-apiserver-proxy-ip-10-0-136-140.ec2.internal\" (UID: \"16feb325486f0987d2add9b4aa5c9287\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.268723 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.268698 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.369401 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.369339 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.404806 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.404782 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.408391 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.408376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.470153 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.470128 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.570701 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.570678 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.671160 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.671116 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found" Sep 17 18:39:06.713450 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.713430 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:06.722551 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.722536 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:06.775429 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.775410 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.784573 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.784559 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 18:39:06.784687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.784668 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:39:06.784726 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.784711 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:39:06.784777 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.784711 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:39:06.784777 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.784757 2552 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a5a035b3ce8f740b49a08d3c03ecad15-9f51263538568f3b.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.136.140:58420->52.201.119.164:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.784842 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.784779 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" Sep 17 18:39:06.801522 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.801503 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 18:39:06.821661 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.821641 2552 apiserver.go:52] "Watching apiserver" Sep 17 18:39:06.827443 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.827426 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 18:39:06.827801 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.827782 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4jzqs","kube-system/konnectivity-agent-74xw6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s","openshift-cluster-node-tuning-operator/tuned-mzmsh","openshift-image-registry/node-ca-dq4qh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal","openshift-multus/network-metrics-daemon-tzrr8","openshift-network-diagnostics/network-check-target-vq7nq","kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal","openshift-dns/node-resolver-rqw9r","openshift-multus/multus-additional-cni-plugins-wgpw8","openshift-multus/multus-slrz2","openshift-network-operator/iptables-alerter-lrb2l","openshift-ovn-kubernetes/ovnkube-node-cx9tc"] Sep 17 18:39:06.829080 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.829064 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.829159 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.829139 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:06.829986 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.829973 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.831022 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.831005 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.832080 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.832061 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.832262 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.832239 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 18:39:06.832354 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.832274 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 18:39:06.832409 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.832395 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-txhbq\"" Sep 17 18:39:06.833035 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.833020 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s9bdv\"" Sep 17 18:39:06.833213 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.833197 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.833271 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.833249 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.833321 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.833203 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 18:39:06.833539 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.833527 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.834254 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.834228 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.834347 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.834322 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jf7jl\"" Sep 17 18:39:06.834682 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.834658 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.836773 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.836743 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:06.836851 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.836822 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:06.837638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.837619 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 18:39:06.837768 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.837740 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.837768 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.837763 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:06.837875 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.837804 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:06.838147 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.838134 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.838297 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.838286 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v6bs9\"" Sep 17 18:39:06.839247 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.839234 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.840395 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.840379 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.840836 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.840821 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.841164 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.841137 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.841164 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.841153 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-np227\"" Sep 17 18:39:06.841740 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.841728 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.842916 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.842900 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.844113 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.844098 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.845161 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.845145 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.845161 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.845155 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 18:39:06.845327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.845173 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.845327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.845202 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 18:39:06.845327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.845224 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 18:39:06.845519 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.845504 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pmwvn\"" Sep 17 18:39:06.848004 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.847990 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 18:39:06.848108 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848091 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.848108 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848104 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.848204 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848108 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 18:39:06.848416 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848388 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 18:39:06.848416 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848411 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 18:39:06.848524 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848420 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vldp\"" Sep 17 18:39:06.848524 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848389 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 18:39:06.848524 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848491 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c9tth\"" Sep 17 18:39:06.848757 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848732 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 18:39:06.848801 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848771 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 18:39:06.848829 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.848811 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 18:39:06.849033 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.849009 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rrhvv\"" Sep 17 18:39:06.872669 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.872609 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 18:34:05 +0000 UTC" deadline="2028-03-20 10:28:53.694001981 +0000 UTC" Sep 17 18:39:06.872669 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.872651 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13191h49m46.821354075s" Sep 17 18:39:06.875042 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.875020 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 18:39:06.876796 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.876778 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 18:39:06.880616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880596 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-cnibin\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.880728 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880622 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9-konnectivity-ca\") pod \"konnectivity-agent-74xw6\" (UID: \"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9\") " pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.880728 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-socket-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.880728 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-modprobe-d\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.880728 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-var-lib-kubelet\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.880728 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880702 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5m7\" (UniqueName: \"kubernetes.io/projected/86c0d143-f169-4d57-9e63-a38a05dfa978-kube-api-access-fs5m7\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880728 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-iptables-alerter-script\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-host-slash\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880794 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-netns\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880829 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9-agent-certs\") pod \"konnectivity-agent-74xw6\" (UID: \"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9\") " pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86c0d143-f169-4d57-9e63-a38a05dfa978-host\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880874 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-kubelet\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-kubelet\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880903 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880934 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qn6s\" (UniqueName: \"kubernetes.io/projected/fdb9f126-c797-42cf-95b7-fb6e386a837d-kube-api-access-6qn6s\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880953 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18d54f5d-bdbe-4c39-8a52-15b7075ef194-kubelet-config\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.881001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-sys\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.880987 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pxq2\" (UniqueName: \"kubernetes.io/projected/bcd8807d-feac-49a0-a8ad-9a106f894cf3-kube-api-access-7pxq2\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-cni-bin\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75e3af6c-dab4-421b-8c64-a3341251b356-multus-daemon-config\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881069 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32458501-95c6-4f9c-8455-8ca5a33f6fc3-tmp\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881084 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-conf-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881110 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-systemd-units\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-run\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcd8807d-feac-49a0-a8ad-9a106f894cf3-hosts-file\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881158 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-socket-dir-parent\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881189 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-etc-kubernetes\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6vb\" (UniqueName: \"kubernetes.io/projected/75e3af6c-dab4-421b-8c64-a3341251b356-kube-api-access-qz6vb\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881227 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881246 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-node-log\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881266 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-registration-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.881501 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881284 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881310 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wlf\" (UniqueName: \"kubernetes.io/projected/da474c08-f4ce-43e1-82c1-d176e9ee788a-kube-api-access-c4wlf\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881329 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-kubernetes\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881342 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-slash\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881381 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovnkube-script-lib\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881407 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvlrp\" (UniqueName: \"kubernetes.io/projected/66bf0137-1227-44aa-a252-3dfaea381b1f-kube-api-access-rvlrp\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dmcx\" (UniqueName: \"kubernetes.io/projected/3486c21b-a0a7-4f9e-8543-be20f1939cb0-kube-api-access-5dmcx\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881445 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-multus-certs\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881459 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovnkube-config\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881473 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-env-overrides\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881486 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881533 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-cni-multus\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881548 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-log-socket\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881561 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysctl-d\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-system-cni-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.882005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-var-lib-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881615 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-etc-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-lib-modules\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881646 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbv2\" (UniqueName: \"kubernetes.io/projected/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-kube-api-access-mnbv2\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cnibin\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-ovn\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-cni-netd\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881757 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysctl-conf\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-systemd\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881802 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-host\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881816 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-tuned\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881835 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881862 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18d54f5d-bdbe-4c39-8a52-15b7075ef194-dbus\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xxrg\" (UniqueName: \"kubernetes.io/projected/32458501-95c6-4f9c-8455-8ca5a33f6fc3-kube-api-access-5xxrg\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881946 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86c0d143-f169-4d57-9e63-a38a05dfa978-serviceca\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.882532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881971 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd8807d-feac-49a0-a8ad-9a106f894cf3-tmp-dir\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.881991 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-hostroot\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-run-netns\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882057 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-system-cni-dir\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882079 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-cni-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882121 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-cni-bin\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-sys-fs\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882165 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882187 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75e3af6c-dab4-421b-8c64-a3341251b356-cni-binary-copy\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882232 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-k8s-cni-cncf-io\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882261 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-systemd\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882291 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-device-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882362 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysconfig\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.883091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.882375 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.891730 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.891711 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 18:39:06.919087 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.919071 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c5xlf" Sep 17 18:39:06.928052 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.927994 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c5xlf" Sep 17 18:39:06.982575 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982545 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovnkube-script-lib\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.982670 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982582 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvlrp\" (UniqueName: \"kubernetes.io/projected/66bf0137-1227-44aa-a252-3dfaea381b1f-kube-api-access-rvlrp\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:06.982670 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982608 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dmcx\" (UniqueName: \"kubernetes.io/projected/3486c21b-a0a7-4f9e-8543-be20f1939cb0-kube-api-access-5dmcx\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.982670 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-multus-certs\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.982670 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovnkube-config\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.982906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-env-overrides\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.982956 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.983007 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.982943 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-multus-certs\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983156 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-cni-multus\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983198 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-log-socket\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysctl-d\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983242 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-cni-multus\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983289 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-log-socket\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983303 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-system-cni-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983248 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-system-cni-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983347 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-var-lib-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983357 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-env-overrides\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983370 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-etc-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983391 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-lib-modules\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983397 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysctl-d\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983416 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbv2\" (UniqueName: \"kubernetes.io/projected/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-kube-api-access-mnbv2\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983428 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-var-lib-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983440 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cnibin\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983440 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-etc-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983458 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovnkube-script-lib\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.983590 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983461 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovnkube-config\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983489 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-ovn\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983513 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-cni-netd\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983517 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-lib-modules\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983538 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysctl-conf\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983547 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983560 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-ovn\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983561 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-systemd\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983561 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-cni-netd\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983609 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cnibin\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983615 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-host\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983630 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-systemd\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983648 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysctl-conf\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983651 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-host\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983680 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-tuned\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18d54f5d-bdbe-4c39-8a52-15b7075ef194-dbus\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.984616 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983737 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983762 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.983828 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983874 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18d54f5d-bdbe-4c39-8a52-15b7075ef194-dbus\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.983888 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:07.483870147 +0000 UTC m=+3.716444150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983771 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xxrg\" (UniqueName: \"kubernetes.io/projected/32458501-95c6-4f9c-8455-8ca5a33f6fc3-kube-api-access-5xxrg\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983918 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86c0d143-f169-4d57-9e63-a38a05dfa978-serviceca\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd8807d-feac-49a0-a8ad-9a106f894cf3-tmp-dir\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983964 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-hostroot\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983988 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-run-netns\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984015 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-system-cni-dir\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984040 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984065 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-cni-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984089 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-cni-bin\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984098 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-run-netns\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-sys-fs\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.983938 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 18:39:06.985604 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984186 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75e3af6c-dab4-421b-8c64-a3341251b356-cni-binary-copy\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984211 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-k8s-cni-cncf-io\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984232 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-systemd\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984257 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984280 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-device-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984284 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-system-cni-dir\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984306 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysconfig\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984312 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86c0d143-f169-4d57-9e63-a38a05dfa978-serviceca\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984325 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-hostroot\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-cnibin\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984369 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-sys-fs\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984232 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd8807d-feac-49a0-a8ad-9a106f894cf3-tmp-dir\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984415 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9-konnectivity-ca\") pod \"konnectivity-agent-74xw6\" (UID: \"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9\") " pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984440 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-socket-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.986412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984456 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-cni-bin\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984464 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-modprobe-d\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984477 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-cnibin\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984500 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984531 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-device-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984536 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-cni-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984539 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-k8s-cni-cncf-io\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984577 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-var-lib-kubelet\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984605 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-modprobe-d\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984631 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-socket-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984637 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-systemd\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984689 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-var-lib-kubelet\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984604 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5m7\" (UniqueName: \"kubernetes.io/projected/86c0d143-f169-4d57-9e63-a38a05dfa978-kube-api-access-fs5m7\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-iptables-alerter-script\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984766 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-host-slash\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984793 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-netns\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984820 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9-agent-certs\") pod \"konnectivity-agent-74xw6\" (UID: \"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9\") " pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984843 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86c0d143-f169-4d57-9e63-a38a05dfa978-host\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.987049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984890 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-kubelet\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984906 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-kubelet\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984922 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984939 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75e3af6c-dab4-421b-8c64-a3341251b356-cni-binary-copy\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qn6s\" (UniqueName: \"kubernetes.io/projected/fdb9f126-c797-42cf-95b7-fb6e386a837d-kube-api-access-6qn6s\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.984987 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18d54f5d-bdbe-4c39-8a52-15b7075ef194-kubelet-config\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985007 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3486c21b-a0a7-4f9e-8543-be20f1939cb0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985011 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-sys\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985053 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pxq2\" (UniqueName: \"kubernetes.io/projected/bcd8807d-feac-49a0-a8ad-9a106f894cf3-kube-api-access-7pxq2\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985078 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-cni-bin\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985056 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-sys\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985088 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985102 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75e3af6c-dab4-421b-8c64-a3341251b356-multus-daemon-config\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985125 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32458501-95c6-4f9c-8455-8ca5a33f6fc3-tmp\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985132 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-host-slash\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985148 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-conf-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985191 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86c0d143-f169-4d57-9e63-a38a05dfa978-host\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.987906 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985197 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-systemd-units\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-run\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985241 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcd8807d-feac-49a0-a8ad-9a106f894cf3-hosts-file\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985250 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9-konnectivity-ca\") pod \"konnectivity-agent-74xw6\" (UID: \"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9\") " pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985265 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-kubelet\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985266 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-socket-dir-parent\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985301 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-etc-kubernetes\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985314 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-var-lib-cni-bin\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985317 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-socket-dir-parent\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985328 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6vb\" (UniqueName: \"kubernetes.io/projected/75e3af6c-dab4-421b-8c64-a3341251b356-kube-api-access-qz6vb\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985366 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-multus-conf-dir\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985376 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-kubelet\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985412 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-systemd-units\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985423 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-sysconfig\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985446 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985458 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-run\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985521 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcd8807d-feac-49a0-a8ad-9a106f894cf3-hosts-file\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985583 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-etc-kubernetes\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.988638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985624 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3486c21b-a0a7-4f9e-8543-be20f1939cb0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985702 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-run-openvswitch\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985743 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75e3af6c-dab4-421b-8c64-a3341251b356-host-run-netns\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985701 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18d54f5d-bdbe-4c39-8a52-15b7075ef194-kubelet-config\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985637 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-node-log\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985766 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75e3af6c-dab4-421b-8c64-a3341251b356-multus-daemon-config\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-registration-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.985838 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985849 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-node-log\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.985922 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-registration-dir\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.985957 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:39:07.485928539 +0000 UTC m=+3.718502549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986105 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-iptables-alerter-script\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986450 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wlf\" (UniqueName: \"kubernetes.io/projected/da474c08-f4ce-43e1-82c1-d176e9ee788a-kube-api-access-c4wlf\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-kubernetes\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986571 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-slash\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989361 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986634 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da474c08-f4ce-43e1-82c1-d176e9ee788a-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986687 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-kubernetes\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.986735 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdb9f126-c797-42cf-95b7-fb6e386a837d-host-slash\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.987926 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32458501-95c6-4f9c-8455-8ca5a33f6fc3-etc-tuned\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.988256 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32458501-95c6-4f9c-8455-8ca5a33f6fc3-tmp\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.989135 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9-agent-certs\") pod \"konnectivity-agent-74xw6\" (UID: \"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9\") " pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:06.989946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.989298 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fdb9f126-c797-42cf-95b7-fb6e386a837d-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:06.993857 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.993828 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dmcx\" (UniqueName: \"kubernetes.io/projected/3486c21b-a0a7-4f9e-8543-be20f1939cb0-kube-api-access-5dmcx\") pod \"multus-additional-cni-plugins-wgpw8\" (UID: \"3486c21b-a0a7-4f9e-8543-be20f1939cb0\") " pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:06.997258 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.997233 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:06.997258 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.997259 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:06.997402 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.997271 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:06.997402 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:06.997330 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:39:07.497314537 +0000 UTC m=+3.729888544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:06.997574 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.997549 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvlrp\" (UniqueName: \"kubernetes.io/projected/66bf0137-1227-44aa-a252-3dfaea381b1f-kube-api-access-rvlrp\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:06.997946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.997922 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5m7\" (UniqueName: \"kubernetes.io/projected/86c0d143-f169-4d57-9e63-a38a05dfa978-kube-api-access-fs5m7\") pod \"node-ca-dq4qh\" (UID: \"86c0d143-f169-4d57-9e63-a38a05dfa978\") " pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:06.998125 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.998101 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbv2\" (UniqueName: \"kubernetes.io/projected/c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8-kube-api-access-mnbv2\") pod \"iptables-alerter-lrb2l\" (UID: \"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8\") " pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:06.998983 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.998958 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6vb\" (UniqueName: \"kubernetes.io/projected/75e3af6c-dab4-421b-8c64-a3341251b356-kube-api-access-qz6vb\") pod \"multus-slrz2\" (UID: \"75e3af6c-dab4-421b-8c64-a3341251b356\") " pod="openshift-multus/multus-slrz2" Sep 17 18:39:06.999090 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.999048 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xxrg\" (UniqueName: \"kubernetes.io/projected/32458501-95c6-4f9c-8455-8ca5a33f6fc3-kube-api-access-5xxrg\") pod \"tuned-mzmsh\" (UID: \"32458501-95c6-4f9c-8455-8ca5a33f6fc3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:06.999776 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:06.999759 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qn6s\" (UniqueName: \"kubernetes.io/projected/fdb9f126-c797-42cf-95b7-fb6e386a837d-kube-api-access-6qn6s\") pod \"ovnkube-node-cx9tc\" (UID: \"fdb9f126-c797-42cf-95b7-fb6e386a837d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:07.000095 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.000080 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pxq2\" (UniqueName: \"kubernetes.io/projected/bcd8807d-feac-49a0-a8ad-9a106f894cf3-kube-api-access-7pxq2\") pod \"node-resolver-rqw9r\" (UID: \"bcd8807d-feac-49a0-a8ad-9a106f894cf3\") " pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:07.001718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.001699 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wlf\" (UniqueName: \"kubernetes.io/projected/da474c08-f4ce-43e1-82c1-d176e9ee788a-kube-api-access-c4wlf\") pod \"aws-ebs-csi-driver-node-m6q6s\" (UID: \"da474c08-f4ce-43e1-82c1-d176e9ee788a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:07.037679 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.037646 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16feb325486f0987d2add9b4aa5c9287.slice/crio-20a50746d5afc82c792162f40ff27600043f8ecef207d958f88b77ecb9856ce2 WatchSource:0}: Error finding container 20a50746d5afc82c792162f40ff27600043f8ecef207d958f88b77ecb9856ce2: Status 404 returned error can't find the container with id 20a50746d5afc82c792162f40ff27600043f8ecef207d958f88b77ecb9856ce2 Sep 17 18:39:07.038624 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.038604 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0160a3929891b136e3cfbbb46a2b3ba2.slice/crio-3f66d39034f58e12d1720ea8df71bb7047fec7be7d3d9ad2cd24dfa942a59367 WatchSource:0}: Error finding container 3f66d39034f58e12d1720ea8df71bb7047fec7be7d3d9ad2cd24dfa942a59367: Status 404 returned error can't find the container with id 3f66d39034f58e12d1720ea8df71bb7047fec7be7d3d9ad2cd24dfa942a59367 Sep 17 18:39:07.044265 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.044246 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:39:07.149238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.149209 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:07.157709 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.157686 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0724d8_5e19_4333_8dd1_e9f4a9f27ae9.slice/crio-25eeb99906c3cb55ff2fc6fda89bb5104cc43c81b20d26d19fb745fa7c2b410b WatchSource:0}: Error finding container 25eeb99906c3cb55ff2fc6fda89bb5104cc43c81b20d26d19fb745fa7c2b410b: Status 404 returned error can't find the container with id 25eeb99906c3cb55ff2fc6fda89bb5104cc43c81b20d26d19fb745fa7c2b410b Sep 17 18:39:07.173114 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.173092 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" Sep 17 18:39:07.180085 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.180038 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda474c08_f4ce_43e1_82c1_d176e9ee788a.slice/crio-887ecd12ffc6d4f25956dcd9e018f8f197c54f0e46ee3aac074ebfab537087c0 WatchSource:0}: Error finding container 887ecd12ffc6d4f25956dcd9e018f8f197c54f0e46ee3aac074ebfab537087c0: Status 404 returned error can't find the container with id 887ecd12ffc6d4f25956dcd9e018f8f197c54f0e46ee3aac074ebfab537087c0 Sep 17 18:39:07.184356 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.184338 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" Sep 17 18:39:07.191240 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.191217 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32458501_95c6_4f9c_8455_8ca5a33f6fc3.slice/crio-42643b5cf19dfc2b6a48735d8c8a52806397472766124931a0d174773fe9c7e9 WatchSource:0}: Error finding container 42643b5cf19dfc2b6a48735d8c8a52806397472766124931a0d174773fe9c7e9: Status 404 returned error can't find the container with id 42643b5cf19dfc2b6a48735d8c8a52806397472766124931a0d174773fe9c7e9 Sep 17 18:39:07.208911 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.208883 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq4qh" Sep 17 18:39:07.216109 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.216086 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c0d143_f169_4d57_9e63_a38a05dfa978.slice/crio-c503c452db6d87c678b63915ed6c81691806cb2da9a34a26ce643438124d9485 WatchSource:0}: Error finding container c503c452db6d87c678b63915ed6c81691806cb2da9a34a26ce643438124d9485: Status 404 returned error can't find the container with id c503c452db6d87c678b63915ed6c81691806cb2da9a34a26ce643438124d9485 Sep 17 18:39:07.216769 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.216736 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqw9r" Sep 17 18:39:07.224260 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.224239 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd8807d_feac_49a0_a8ad_9a106f894cf3.slice/crio-d9b5dccdff41a365b4fbf6d3a4a5264ae0cb9b6b0c2ef7d0ea5eefdb30fb0b54 WatchSource:0}: Error finding container d9b5dccdff41a365b4fbf6d3a4a5264ae0cb9b6b0c2ef7d0ea5eefdb30fb0b54: Status 404 returned error can't find the container with id d9b5dccdff41a365b4fbf6d3a4a5264ae0cb9b6b0c2ef7d0ea5eefdb30fb0b54 Sep 17 18:39:07.249841 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.249813 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" Sep 17 18:39:07.257141 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.257120 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3486c21b_a0a7_4f9e_8543_be20f1939cb0.slice/crio-4cc60f5010543ea3057e23698f072b17fade53c4b1d9d1647402b11a6f8ba10b WatchSource:0}: Error finding container 4cc60f5010543ea3057e23698f072b17fade53c4b1d9d1647402b11a6f8ba10b: Status 404 returned error can't find the container with id 4cc60f5010543ea3057e23698f072b17fade53c4b1d9d1647402b11a6f8ba10b Sep 17 18:39:07.269662 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.269644 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slrz2" Sep 17 18:39:07.276957 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.276935 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e3af6c_dab4_421b_8c64_a3341251b356.slice/crio-4f48757d7b320acadf160c6d2b27a33921aafe38e4b77bf2537f41b52c381721 WatchSource:0}: Error finding container 4f48757d7b320acadf160c6d2b27a33921aafe38e4b77bf2537f41b52c381721: Status 404 returned error can't find the container with id 4f48757d7b320acadf160c6d2b27a33921aafe38e4b77bf2537f41b52c381721 Sep 17 18:39:07.283989 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.283973 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrb2l" Sep 17 18:39:07.292683 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.292649 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93fb9c1_3b52_40c3_9de8_ddfa9b4567d8.slice/crio-6a43947666a5b1437e8203fd2600b64133393999b6f9598b2d8e0fefddbdc755 WatchSource:0}: Error finding container 6a43947666a5b1437e8203fd2600b64133393999b6f9598b2d8e0fefddbdc755: Status 404 returned error can't find the container with id 6a43947666a5b1437e8203fd2600b64133393999b6f9598b2d8e0fefddbdc755 Sep 17 18:39:07.296532 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.296517 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:07.304333 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:07.304315 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb9f126_c797_42cf_95b7_fb6e386a837d.slice/crio-83b64d10d07971424656eaff14984c1d2220a17e8e5ec21a9bc593427e1c6e59 WatchSource:0}: Error finding container 83b64d10d07971424656eaff14984c1d2220a17e8e5ec21a9bc593427e1c6e59: Status 404 returned error can't find the container with id 83b64d10d07971424656eaff14984c1d2220a17e8e5ec21a9bc593427e1c6e59 Sep 17 18:39:07.451045 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.451021 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:07.490672 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.490644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:07.490835 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.490704 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:07.490835 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.490800 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:07.490948 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.490825 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:07.490948 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.490873 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:08.490855404 +0000 UTC m=+4.723429410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:07.490948 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.490895 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:39:08.490885255 +0000 UTC m=+4.723459259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:07.591853 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.591821 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:07.592053 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.592002 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:07.592053 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.592033 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:07.592053 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.592046 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:07.592222 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.592106 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:39:08.592086377 +0000 UTC m=+4.824660381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:07.925111 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.925043 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:07.933853 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.933804 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:34:06 +0000 UTC" deadline="2028-05-09 13:29:37.709687018 +0000 UTC" Sep 17 18:39:07.933853 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.933853 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14394h50m29.775837555s" Sep 17 18:39:07.975082 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:07.974892 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:07.975082 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:07.975019 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:08.032385 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.032329 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"83b64d10d07971424656eaff14984c1d2220a17e8e5ec21a9bc593427e1c6e59"} Sep 17 18:39:08.049095 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.049064 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrb2l" event={"ID":"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8","Type":"ContainerStarted","Data":"6a43947666a5b1437e8203fd2600b64133393999b6f9598b2d8e0fefddbdc755"} Sep 17 18:39:08.056451 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.056426 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slrz2" event={"ID":"75e3af6c-dab4-421b-8c64-a3341251b356","Type":"ContainerStarted","Data":"4f48757d7b320acadf160c6d2b27a33921aafe38e4b77bf2537f41b52c381721"} Sep 17 18:39:08.068201 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.068172 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq4qh" event={"ID":"86c0d143-f169-4d57-9e63-a38a05dfa978","Type":"ContainerStarted","Data":"c503c452db6d87c678b63915ed6c81691806cb2da9a34a26ce643438124d9485"} Sep 17 18:39:08.077119 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.077093 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" event={"ID":"32458501-95c6-4f9c-8455-8ca5a33f6fc3","Type":"ContainerStarted","Data":"42643b5cf19dfc2b6a48735d8c8a52806397472766124931a0d174773fe9c7e9"} Sep 17 18:39:08.086319 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.086293 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" event={"ID":"16feb325486f0987d2add9b4aa5c9287","Type":"ContainerStarted","Data":"20a50746d5afc82c792162f40ff27600043f8ecef207d958f88b77ecb9856ce2"} Sep 17 18:39:08.096840 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.096809 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" event={"ID":"0160a3929891b136e3cfbbb46a2b3ba2","Type":"ContainerStarted","Data":"3f66d39034f58e12d1720ea8df71bb7047fec7be7d3d9ad2cd24dfa942a59367"} Sep 17 18:39:08.108388 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.108364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerStarted","Data":"4cc60f5010543ea3057e23698f072b17fade53c4b1d9d1647402b11a6f8ba10b"} Sep 17 18:39:08.121360 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.121338 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqw9r" event={"ID":"bcd8807d-feac-49a0-a8ad-9a106f894cf3","Type":"ContainerStarted","Data":"d9b5dccdff41a365b4fbf6d3a4a5264ae0cb9b6b0c2ef7d0ea5eefdb30fb0b54"} Sep 17 18:39:08.141898 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.141858 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" event={"ID":"da474c08-f4ce-43e1-82c1-d176e9ee788a","Type":"ContainerStarted","Data":"887ecd12ffc6d4f25956dcd9e018f8f197c54f0e46ee3aac074ebfab537087c0"} Sep 17 18:39:08.163030 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.163006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-74xw6" event={"ID":"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9","Type":"ContainerStarted","Data":"25eeb99906c3cb55ff2fc6fda89bb5104cc43c81b20d26d19fb745fa7c2b410b"} Sep 17 18:39:08.498137 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.498104 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:08.498319 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.498175 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:08.498319 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.498291 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:08.498434 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.498349 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:39:10.498330231 +0000 UTC m=+6.730904248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:08.498841 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.498820 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:08.498959 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.498872 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:10.498858344 +0000 UTC m=+6.731432361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:08.598781 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.598730 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:08.599004 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.598900 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:08.599004 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.598918 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:08.599004 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.598930 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:08.599004 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.598996 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:39:10.598977318 +0000 UTC m=+6.831551321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:08.934516 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.934424 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:34:06 +0000 UTC" deadline="2028-05-07 23:08:07.485805641 +0000 UTC" Sep 17 18:39:08.934516 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.934467 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14356h28m58.551342424s" Sep 17 18:39:08.973246 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.973195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:08.973426 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.973326 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:08.973721 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:08.973701 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:08.973866 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:08.973816 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:09.254657 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:09.254625 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:09.255991 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:09.255967 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:39:09.973709 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:09.972961 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:09.973709 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:09.973093 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:10.515681 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:10.515650 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:10.515871 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:10.515715 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:10.515871 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.515856 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:10.516002 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.515917 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:14.515897234 +0000 UTC m=+10.748471253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:10.516332 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.516183 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:10.516332 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.516250 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:39:14.516231373 +0000 UTC m=+10.748805394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:10.616382 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:10.616348 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:10.616628 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.616606 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:10.616705 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.616638 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:10.616705 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.616659 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:10.616832 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.616716 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:39:14.616697625 +0000 UTC m=+10.849271651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:10.972578 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:10.972517 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:10.972887 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.972647 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:10.972887 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:10.972681 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:10.972887 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:10.972813 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:11.972772 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:11.972444 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:11.972772 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:11.972594 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:12.972478 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:12.972445 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:12.972672 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:12.972495 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:12.972672 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:12.972583 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:12.972838 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:12.972729 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:13.973638 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:13.973604 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:13.974100 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:13.973762 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:14.548204 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:14.547883 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:14.548204 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:14.547970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:14.548204 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.548088 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:14.548204 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.548101 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:14.548204 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.548160 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:39:22.548140181 +0000 UTC m=+18.780714191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:14.548204 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.548178 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:22.54816833 +0000 UTC m=+18.780742340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:14.649019 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:14.648976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:14.649195 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.649141 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:14.649195 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.649166 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:14.649195 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.649179 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:14.649334 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.649240 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:39:22.64922199 +0000 UTC m=+18.881795999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:14.972800 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:14.972768 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:14.972969 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.972896 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:14.973289 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:14.973271 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:14.973376 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:14.973362 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:15.973783 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:15.973734 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:15.974222 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:15.973877 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:16.973022 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:16.972987 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:16.973192 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:16.973118 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:16.973192 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:16.972987 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:16.973314 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:16.973210 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:17.973237 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:17.973202 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:17.973678 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:17.973343 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:18.972430 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:18.972394 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:18.972610 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:18.972507 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:18.972610 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:18.972568 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:18.972741 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:18.972675 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:19.973243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:19.973212 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:19.973732 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:19.973340 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:20.972156 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:20.972126 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:20.972312 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:20.972127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:20.972312 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:20.972237 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:20.972418 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:20.972313 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:21.973119 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:21.973083 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:21.973586 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:21.973225 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:22.605261 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:22.605223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:22.605447 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:22.605291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:22.605447 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.605355 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:22.605447 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.605379 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:22.605447 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.605424 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:39:38.605404027 +0000 UTC m=+34.837978034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:22.605447 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.605440 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:38.605433711 +0000 UTC m=+34.838007713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:22.706412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:22.706383 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:22.706577 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.706553 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:22.706577 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.706574 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:22.706675 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.706586 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:22.706675 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.706646 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:39:38.706628826 +0000 UTC m=+34.939202828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:22.972512 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:22.972479 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:22.972699 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:22.972489 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:22.972699 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.972597 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:22.972699 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:22.972673 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:23.973139 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:23.973104 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:23.973586 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:23.973230 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:24.972730 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:24.972696 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:24.972918 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:24.972847 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:24.972918 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:24.972882 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:24.973018 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:24.973002 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:25.973640 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:25.973620 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:25.974028 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:25.973697 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:26.212135 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.212108 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"abf0eced65d5d6de1fa37d4fc58976cf355ff7cf7e0c6bcf57944800cb91ebb5"} Sep 17 18:39:26.213555 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.213528 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" event={"ID":"32458501-95c6-4f9c-8455-8ca5a33f6fc3","Type":"ContainerStarted","Data":"6c3993934024d543f4d83e1a4fe6dd0f5ad8ac5f418e5cd7bffc8d77aaacf5f2"} Sep 17 18:39:26.215020 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.214999 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" event={"ID":"16feb325486f0987d2add9b4aa5c9287","Type":"ContainerStarted","Data":"bfa7b9c767bda86457ef9b6f134aaf7033aa365df3f087ec2371ece3e9471710"} Sep 17 18:39:26.238161 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.238108 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mzmsh" podStartSLOduration=1.518013969 podStartE2EDuration="20.23809126s" totalImagesPullingTime="18.720077291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:26.237700952 +0000 UTC m=+22.470274978" watchObservedRunningTime="2026-09-17 18:39:26.23809126 +0000 UTC m=+22.470665288" Sep 17 18:39:26.254738 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.254702 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" podStartSLOduration=20.25469069 podStartE2EDuration="20.25469069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:26.254482919 +0000 UTC m=+22.487056966" watchObservedRunningTime="2026-09-17 18:39:26.25469069 +0000 UTC m=+22.487264712" Sep 17 18:39:26.972777 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.972598 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:26.972881 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:26.972667 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:26.972881 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:26.972842 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:26.972955 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:26.972907 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:27.219052 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.218980 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slrz2" event={"ID":"75e3af6c-dab4-421b-8c64-a3341251b356","Type":"ContainerStarted","Data":"8bffbf5b7d3b79c4689d6baab7fe7f52b6977eea6efd9030bde07ec68aa7cedc"} Sep 17 18:39:27.221158 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.221128 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq4qh" event={"ID":"86c0d143-f169-4d57-9e63-a38a05dfa978","Type":"ContainerStarted","Data":"d7fa57341e50c2a745374d976cd9e9419da1c7933414a5d10a11886c0623ec39"} Sep 17 18:39:27.223028 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.223005 2552 generic.go:356] "Generic (PLEG): container finished" podID="0160a3929891b136e3cfbbb46a2b3ba2" containerID="cb751c01c639087d8163be561df39201690cb52f63db90b9f421528d58ec1e6d" exitCode=0 Sep 17 18:39:27.223153 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.223082 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" event={"ID":"0160a3929891b136e3cfbbb46a2b3ba2","Type":"ContainerDied","Data":"cb751c01c639087d8163be561df39201690cb52f63db90b9f421528d58ec1e6d"} Sep 17 18:39:27.224827 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.224804 2552 generic.go:356] "Generic (PLEG): container finished" podID="3486c21b-a0a7-4f9e-8543-be20f1939cb0" containerID="2614e86be7c00273a6510092cf4dcbee2c37895a3edd2f747616e52a131ef634" exitCode=0 Sep 17 18:39:27.224939 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.224871 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerDied","Data":"2614e86be7c00273a6510092cf4dcbee2c37895a3edd2f747616e52a131ef634"} Sep 17 18:39:27.226665 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.226642 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqw9r" event={"ID":"bcd8807d-feac-49a0-a8ad-9a106f894cf3","Type":"ContainerStarted","Data":"8b693401d26078a6d5cf94f3aa5e4354e27b42a08e1dcb460eff9b968dc66253"} Sep 17 18:39:27.228534 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.228508 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" event={"ID":"da474c08-f4ce-43e1-82c1-d176e9ee788a","Type":"ContainerStarted","Data":"cbf3992c8dcc35432d8466255a6ede4820ec4acc5830fe65e9f0452fea8cc79e"} Sep 17 18:39:27.230118 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.230064 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-74xw6" event={"ID":"3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9","Type":"ContainerStarted","Data":"e38252e42af0494766c830c3178e586f391ebf70032c8b58c825fa755511fabf"} Sep 17 18:39:27.235646 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.235627 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:39:27.236170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.236146 2552 generic.go:356] "Generic (PLEG): container finished" podID="fdb9f126-c797-42cf-95b7-fb6e386a837d" containerID="bdc607485614b9761afb3cb90c377e94e7e159bd05f597ddd53fd8e3a91af645" exitCode=1 Sep 17 18:39:27.236281 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.236217 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"5961c02e2973e361172ed1a76758483481fb57bbc3a225eb529250c6f41f3fb1"} Sep 17 18:39:27.236343 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.236297 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"34ef901005ed7cd516645399cd86e70b476f0ca18c522f9f5bc9233aae2db51e"} Sep 17 18:39:27.236394 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.236350 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"857dfd4f78b62b58bcbf9d61f0978f001ff95de0b5408a9f1af89f6c2027606f"} Sep 17 18:39:27.236446 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.236400 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"0198112b10f5be3a63d679eab3d7a34db1291a3bf955730ac1e0cbd2e6600e8b"} Sep 17 18:39:27.236446 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.236439 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerDied","Data":"bdc607485614b9761afb3cb90c377e94e7e159bd05f597ddd53fd8e3a91af645"} Sep 17 18:39:27.237902 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.237846 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrb2l" event={"ID":"c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8","Type":"ContainerStarted","Data":"5cad40dd12f02130121adcad7f6ed3c9306a04452fafd771f0230eacd90e1ab9"} Sep 17 18:39:27.238177 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.238136 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-slrz2" podStartSLOduration=2.064529905 podStartE2EDuration="21.238124487s" totalImagesPullingTime="19.173594582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:27.237889448 +0000 UTC m=+23.470463473" watchObservedRunningTime="2026-09-17 18:39:27.238124487 +0000 UTC m=+23.470698511" Sep 17 18:39:27.253328 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.253291 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dq4qh" podStartSLOduration=2.589845442 podStartE2EDuration="21.253279538s" totalImagesPullingTime="18.663434096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:27.252874228 +0000 UTC m=+23.485448252" watchObservedRunningTime="2026-09-17 18:39:27.253279538 +0000 UTC m=+23.485853562" Sep 17 18:39:27.267647 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.267610 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rqw9r" podStartSLOduration=2.580126947 podStartE2EDuration="21.267600776s" totalImagesPullingTime="18.687473829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:27.267372066 +0000 UTC m=+23.499946090" watchObservedRunningTime="2026-09-17 18:39:27.267600776 +0000 UTC m=+23.500174801" Sep 17 18:39:27.308677 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.308643 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-74xw6" podStartSLOduration=9.984862452 podStartE2EDuration="21.30862397s" totalImagesPullingTime="11.323761518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:27.308170947 +0000 UTC m=+23.540744973" watchObservedRunningTime="2026-09-17 18:39:27.30862397 +0000 UTC m=+23.541197996" Sep 17 18:39:27.323637 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.323603 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lrb2l" podStartSLOduration=2.736578246 podStartE2EDuration="21.323591214s" totalImagesPullingTime="18.587012968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:27.323208166 +0000 UTC m=+23.555782205" watchObservedRunningTime="2026-09-17 18:39:27.323591214 +0000 UTC m=+23.556165239" Sep 17 18:39:27.402972 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.402946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:27.758695 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.758667 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 18:39:27.948900 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.948792 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T18:39:27.758692728Z","UUID":"9d047a02-d4aa-4ae3-b92e-590390ece48a","Handler":null,"Name":"","Endpoint":""} Sep 17 18:39:27.950333 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.950312 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 18:39:27.950333 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.950346 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 18:39:27.972383 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:27.972360 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:27.972526 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:27.972488 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:28.243046 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:28.243006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" event={"ID":"da474c08-f4ce-43e1-82c1-d176e9ee788a","Type":"ContainerStarted","Data":"08ac724f86943dbb56bc2417d56773558327ce2e2e96b128007fbadb9fc9e2ac"} Sep 17 18:39:28.680073 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:28.680049 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:28.972272 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:28.972248 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:28.972452 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:28.972370 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:28.972452 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:28.972417 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:28.972555 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:28.972514 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:29.249647 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.249624 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:39:29.250136 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.250106 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"6e2bec26fe22cdb49b66d9f610678dab4fabdbda73bf3ce8ed834818b7a323f7"} Sep 17 18:39:29.252259 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.252231 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" event={"ID":"0160a3929891b136e3cfbbb46a2b3ba2","Type":"ContainerStarted","Data":"5d11a9c3405cd9d061d10c6b2021ee896e600b7527f64f5f2f9a14226139f25d"} Sep 17 18:39:29.254634 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.254607 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" event={"ID":"da474c08-f4ce-43e1-82c1-d176e9ee788a","Type":"ContainerStarted","Data":"e91d87529782c27582169310f07c533eec1ad3dfbb6b88a3bb4d53bf6c78edd3"} Sep 17 18:39:29.268673 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.268631 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" podStartSLOduration=23.268611829 podStartE2EDuration="23.268611829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:29.268147023 +0000 UTC m=+25.500721050" watchObservedRunningTime="2026-09-17 18:39:29.268611829 +0000 UTC m=+25.501185854" Sep 17 18:39:29.287539 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.287487 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6q6s" podStartSLOduration=2.529469856 podStartE2EDuration="23.287469307s" totalImagesPullingTime="20.757999451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:29.286919364 +0000 UTC m=+25.519493380" watchObservedRunningTime="2026-09-17 18:39:29.287469307 +0000 UTC m=+25.520043335" Sep 17 18:39:29.936138 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.936104 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:29.936879 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.936854 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:29.972825 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:29.972802 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:29.972954 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:29.972904 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:30.257273 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:30.257179 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:30.257697 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:30.257543 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-74xw6" Sep 17 18:39:30.347716 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:30.347685 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:30.973089 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:30.973057 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:30.973089 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:30.973092 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:30.973301 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:30.973176 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:30.973361 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:30.973307 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:31.605452 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:31.605232 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:31.703500 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:31.703469 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:31.803241 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:31.803216 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:31.903380 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:31.903311 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:31.973056 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:31.973035 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:31.973167 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:31.973143 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:32.264091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.264070 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:39:32.264435 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.264411 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"2e3f277dc31f1fa952cb7e49ef8aa519180df365d749ff00777d4a97a9e26d34"} Sep 17 18:39:32.264729 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.264706 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:32.264872 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.264795 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:32.264872 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.264831 2552 scope.go:117] "RemoveContainer" containerID="bdc607485614b9761afb3cb90c377e94e7e159bd05f597ddd53fd8e3a91af645" Sep 17 18:39:32.264872 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.264846 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:32.266406 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.266386 2552 generic.go:356] "Generic (PLEG): container finished" podID="3486c21b-a0a7-4f9e-8543-be20f1939cb0" containerID="95a3494e06ffc6a8eda90911d074f6fe2a87aff4eb230b65323b4b15b5bbf7a8" exitCode=0 Sep 17 18:39:32.266503 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.266471 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerDied","Data":"95a3494e06ffc6a8eda90911d074f6fe2a87aff4eb230b65323b4b15b5bbf7a8"} Sep 17 18:39:32.281605 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.281585 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:32.281729 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.281717 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:39:32.560036 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.559962 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:32.663088 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.663013 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:32.972939 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.972915 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:32.973035 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:32.972924 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:32.973035 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:32.973017 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:32.973103 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:32.973079 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:33.272328 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.272182 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:39:33.272731 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.272707 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" event={"ID":"fdb9f126-c797-42cf-95b7-fb6e386a837d","Type":"ContainerStarted","Data":"db07b916c2c1f25379e19b0d3f131810ecbaf15001dbe745124f146d7f97d2f8"} Sep 17 18:39:33.274843 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.274819 2552 generic.go:356] "Generic (PLEG): container finished" podID="3486c21b-a0a7-4f9e-8543-be20f1939cb0" containerID="84e636f0068aabe71fa75a5f27c87a9591df70773991d7b325337317414097a2" exitCode=0 Sep 17 18:39:33.274927 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.274860 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerDied","Data":"84e636f0068aabe71fa75a5f27c87a9591df70773991d7b325337317414097a2"} Sep 17 18:39:33.299335 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.299299 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" podStartSLOduration=8.658842478 podStartE2EDuration="27.299285676s" totalImagesPullingTime="18.640443198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:33.298571042 +0000 UTC m=+29.531145067" watchObservedRunningTime="2026-09-17 18:39:33.299285676 +0000 UTC m=+29.531859700" Sep 17 18:39:33.390534 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.390506 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vq7nq"] Sep 17 18:39:33.390650 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.390600 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:33.390715 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:33.390695 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:33.393569 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.393547 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tzrr8"] Sep 17 18:39:33.393646 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.393634 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:33.393725 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:33.393708 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:33.406618 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.406594 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jzqs"] Sep 17 18:39:33.406697 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:33.406657 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:33.406737 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:33.406718 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:34.278979 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:34.278946 2552 generic.go:356] "Generic (PLEG): container finished" podID="3486c21b-a0a7-4f9e-8543-be20f1939cb0" containerID="31cfdeea863292125cfbef943b04288ecac7aeac048e94e784e4b1400518395a" exitCode=0 Sep 17 18:39:34.279405 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:34.279024 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerDied","Data":"31cfdeea863292125cfbef943b04288ecac7aeac048e94e784e4b1400518395a"} Sep 17 18:39:34.973103 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:34.973074 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:34.973234 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:34.973083 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:34.973234 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:34.973199 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:34.973234 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:34.973196 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:34.973343 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:34.973301 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:34.973412 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:34.973390 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:36.973184 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:36.973154 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:36.973601 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:36.973191 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:36.973601 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:36.973191 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:36.973601 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:36.973279 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jzqs" podUID="18d54f5d-bdbe-4c39-8a52-15b7075ef194" Sep 17 18:39:36.973601 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:36.973367 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrr8" podUID="66bf0137-1227-44aa-a252-3dfaea381b1f" Sep 17 18:39:36.973601 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:36.973448 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq7nq" podUID="e25a1940-8018-4b12-9f2e-3da21ee6fd9a" Sep 17 18:39:38.235484 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.235406 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeReady" Sep 17 18:39:38.235952 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.235553 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 18:39:38.310198 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.310169 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vs6h9"] Sep 17 18:39:38.323790 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.323762 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k7ncr"] Sep 17 18:39:38.323971 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.323953 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.329235 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.329173 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f9x8j\"" Sep 17 18:39:38.330068 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.330043 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 18:39:38.330427 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.330396 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vs6h9"] Sep 17 18:39:38.330524 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.330494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.331025 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.331007 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 18:39:38.333185 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.333163 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 18:39:38.333286 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.333273 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 18:39:38.333889 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.333870 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 18:39:38.334310 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.334293 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5pvxj\"" Sep 17 18:39:38.341227 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.340987 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k7ncr"] Sep 17 18:39:38.425299 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.425245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6hph\" (UniqueName: \"kubernetes.io/projected/531f734e-7128-4036-ba93-4b83442841b4-kube-api-access-b6hph\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.425299 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.425294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40341bcb-836b-4800-b641-591c8e03e648-cert\") pod \"ingress-canary-k7ncr\" (UID: \"40341bcb-836b-4800-b641-591c8e03e648\") " pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.425554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.425382 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.425554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.425408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/531f734e-7128-4036-ba93-4b83442841b4-tmp-dir\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.425554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.425438 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42snk\" (UniqueName: \"kubernetes.io/projected/40341bcb-836b-4800-b641-591c8e03e648-kube-api-access-42snk\") pod \"ingress-canary-k7ncr\" (UID: \"40341bcb-836b-4800-b641-591c8e03e648\") " pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.425554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.425503 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/531f734e-7128-4036-ba93-4b83442841b4-config-volume\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.526546 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.526465 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6hph\" (UniqueName: \"kubernetes.io/projected/531f734e-7128-4036-ba93-4b83442841b4-kube-api-access-b6hph\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.526546 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.526513 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40341bcb-836b-4800-b641-591c8e03e648-cert\") pod \"ingress-canary-k7ncr\" (UID: \"40341bcb-836b-4800-b641-591c8e03e648\") " pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.526769 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.526594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.526769 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.526623 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/531f734e-7128-4036-ba93-4b83442841b4-tmp-dir\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.526769 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.526658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42snk\" (UniqueName: \"kubernetes.io/projected/40341bcb-836b-4800-b641-591c8e03e648-kube-api-access-42snk\") pod \"ingress-canary-k7ncr\" (UID: \"40341bcb-836b-4800-b641-591c8e03e648\") " pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.526769 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.526732 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:39:38.526973 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.526818 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/531f734e-7128-4036-ba93-4b83442841b4-config-volume\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.526973 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.526831 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:39.026809848 +0000 UTC m=+35.259383850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:39:38.527075 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.527046 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/531f734e-7128-4036-ba93-4b83442841b4-tmp-dir\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.527405 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.527379 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/531f734e-7128-4036-ba93-4b83442841b4-config-volume\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.531279 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.531256 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40341bcb-836b-4800-b641-591c8e03e648-cert\") pod \"ingress-canary-k7ncr\" (UID: \"40341bcb-836b-4800-b641-591c8e03e648\") " pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.545595 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.545569 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6hph\" (UniqueName: \"kubernetes.io/projected/531f734e-7128-4036-ba93-4b83442841b4-kube-api-access-b6hph\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:38.545709 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.545665 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42snk\" (UniqueName: \"kubernetes.io/projected/40341bcb-836b-4800-b641-591c8e03e648-kube-api-access-42snk\") pod \"ingress-canary-k7ncr\" (UID: \"40341bcb-836b-4800-b641-591c8e03e648\") " pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.584576 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.584541 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:38.627879 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.627846 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:38.628038 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.627913 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:38.628038 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.627988 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:38.628145 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.628055 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:38.628145 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.628064 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret podName:18d54f5d-bdbe-4c39-8a52-15b7075ef194 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.628045759 +0000 UTC m=+66.860619779 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret") pod "global-pull-secret-syncer-4jzqs" (UID: "18d54f5d-bdbe-4c39-8a52-15b7075ef194") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:39:38.628145 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.628119 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.628102124 +0000 UTC m=+66.860676131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:39:38.646137 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.646116 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k7ncr" Sep 17 18:39:38.700325 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.700152 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:38.729155 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.729123 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:38.729298 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.729280 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:39:38.729345 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.729303 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:39:38.729345 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.729312 2552 projected.go:196] Error preparing data for projected volume kube-api-access-4wp75 for pod openshift-network-diagnostics/network-check-target-vq7nq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:38.729411 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:38.729360 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75 podName:e25a1940-8018-4b12-9f2e-3da21ee6fd9a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.729347238 +0000 UTC m=+66.961921245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wp75" (UniqueName: "kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75") pod "network-check-target-vq7nq" (UID: "e25a1940-8018-4b12-9f2e-3da21ee6fd9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:39:38.972900 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.972876 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:39:38.973014 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.972884 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:39:38.973124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.973012 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:39:38.974237 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.974213 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k7ncr"] Sep 17 18:39:38.975219 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.975198 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nghzc\"" Sep 17 18:39:38.975348 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.975230 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 18:39:38.975348 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.975250 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 18:39:38.975348 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.975301 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 18:39:38.975348 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.975332 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 18:39:38.975956 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:38.975942 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shgtw\"" Sep 17 18:39:38.978722 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:39:38.978703 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40341bcb_836b_4800_b641_591c8e03e648.slice/crio-29a64b19f9d84ad0bfcfa17089e668fafab3fc9b0c521d1b9307cc82e0b59439 WatchSource:0}: Error finding container 29a64b19f9d84ad0bfcfa17089e668fafab3fc9b0c521d1b9307cc82e0b59439: Status 404 returned error can't find the container with id 29a64b19f9d84ad0bfcfa17089e668fafab3fc9b0c521d1b9307cc82e0b59439 Sep 17 18:39:39.031116 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:39.031091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:39.031232 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:39.031195 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:39:39.031280 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:39.031268 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:40.031249289 +0000 UTC m=+36.263823294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:39:39.292285 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:39.292249 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k7ncr" event={"ID":"40341bcb-836b-4800-b641-591c8e03e648","Type":"ContainerStarted","Data":"29a64b19f9d84ad0bfcfa17089e668fafab3fc9b0c521d1b9307cc82e0b59439"} Sep 17 18:39:39.295005 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:39.294980 2552 generic.go:356] "Generic (PLEG): container finished" podID="3486c21b-a0a7-4f9e-8543-be20f1939cb0" containerID="15a129776d2e7e4c9b7e0f2de8ee6efa7fc542d48739492a3eba96560f06e992" exitCode=0 Sep 17 18:39:39.295105 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:39.295019 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerDied","Data":"15a129776d2e7e4c9b7e0f2de8ee6efa7fc542d48739492a3eba96560f06e992"} Sep 17 18:39:40.041287 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:40.041251 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:40.041549 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:40.041412 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:39:40.041549 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:40.041482 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:42.041465557 +0000 UTC m=+38.274039591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:39:40.301698 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:40.301623 2552 generic.go:356] "Generic (PLEG): container finished" podID="3486c21b-a0a7-4f9e-8543-be20f1939cb0" containerID="d93437ac9b3ac04327fe9a45f3d7827d59edd19cd1b1e4ebe94c17e77502f578" exitCode=0 Sep 17 18:39:40.301698 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:40.301682 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerDied","Data":"d93437ac9b3ac04327fe9a45f3d7827d59edd19cd1b1e4ebe94c17e77502f578"} Sep 17 18:39:41.309015 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:41.308985 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" event={"ID":"3486c21b-a0a7-4f9e-8543-be20f1939cb0","Type":"ContainerStarted","Data":"fcb92552efdffd87af3dcfd4fa25ccb873d0a05d97866f45ac58c281a0a67f32"} Sep 17 18:39:41.508103 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:41.508072 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:41.623674 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:41.623613 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:42.056215 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:42.056039 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:42.056215 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:42.056196 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:39:42.056423 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:42.056267 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:46.056245925 +0000 UTC m=+42.288819929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:39:42.254417 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:42.254382 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:42.315498 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:42.313230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k7ncr" event={"ID":"40341bcb-836b-4800-b641-591c8e03e648","Type":"ContainerStarted","Data":"f88ab8975f2b839304fba29fd30eb884ff719c3b59569e6146e6315d1e18f4ce"} Sep 17 18:39:42.339363 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:42.339310 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wgpw8" podStartSLOduration=7.530773213 podStartE2EDuration="36.339290772s" totalImagesPullingTime="28.808517559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:41.339936376 +0000 UTC m=+37.572510402" watchObservedRunningTime="2026-09-17 18:39:42.339290772 +0000 UTC m=+38.571864828" Sep 17 18:39:43.996768 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:43.996722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:44.097932 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:44.097905 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:44.602221 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:44.602192 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:44.676221 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:44.676194 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:46.081800 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:46.081770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:46.082182 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:46.081864 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:39:46.082182 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:46.081918 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:54.081906246 +0000 UTC m=+50.314480249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:39:47.625880 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:47.625851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:47.688534 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:47.688512 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:48.179007 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:48.178979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:48.247149 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:48.247120 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:49.110550 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:49.110511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:49.215768 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:49.215723 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:39:54.131461 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:39:54.131430 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:39:54.131844 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:54.131543 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:39:54.131844 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:39:54.131593 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.131578949 +0000 UTC m=+66.364152952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:40:03.417146 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.417097 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k7ncr" podStartSLOduration=22.67298862 podStartE2EDuration="25.41708035s" totalImagesPullingTime="2.74409173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:42.339594694 +0000 UTC m=+38.572168718" watchObservedRunningTime="2026-09-17 18:40:03.41708035 +0000 UTC m=+59.649654374" Sep 17 18:40:03.417598 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.417459 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c69558c48-czg5x"] Sep 17 18:40:03.453149 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.453121 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c69558c48-czg5x"] Sep 17 18:40:03.453282 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.453214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.455654 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.455627 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-klngq\"" Sep 17 18:40:03.455898 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.455684 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 18:40:03.455898 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.455700 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 18:40:03.455898 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.455637 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 18:40:03.456297 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.456282 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 18:40:03.456358 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.456316 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 18:40:03.456435 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.456411 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 18:40:03.531762 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.531718 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc"] Sep 17 18:40:03.533553 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.533538 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.537851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.537831 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 18:40:03.538681 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.538662 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 18:40:03.538814 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.538701 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 18:40:03.538814 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.538702 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jtwd6\"" Sep 17 18:40:03.538814 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.538778 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 18:40:03.557071 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.557046 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc"] Sep 17 18:40:03.591367 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.591343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-stats-auth\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.591459 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.591388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-default-certificate\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.591459 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.591416 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb7tm\" (UniqueName: \"kubernetes.io/projected/6a996323-0a99-46cf-9c16-60932faa1015-kube-api-access-tb7tm\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.591551 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.591458 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.591551 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.591474 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.618414 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.618392 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk"] Sep 17 18:40:03.620052 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.620039 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" Sep 17 18:40:03.622635 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.622609 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:40:03.622718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.622655 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-92vj6\"" Sep 17 18:40:03.622941 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.622925 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 18:40:03.632807 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.632788 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk"] Sep 17 18:40:03.634132 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.634098 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:03.692460 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-stats-auth\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.692540 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692473 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwd58\" (UniqueName: \"kubernetes.io/projected/8514c6da-d925-424d-a11d-7874566241b1-kube-api-access-cwd58\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.692540 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692513 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-default-certificate\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.692540 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692535 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb7tm\" (UniqueName: \"kubernetes.io/projected/6a996323-0a99-46cf-9c16-60932faa1015-kube-api-access-tb7tm\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.692667 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8514c6da-d925-424d-a11d-7874566241b1-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.692667 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.692667 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.692844 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.692672 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.692844 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:03.692739 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 18:40:03.692844 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:03.692818 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:04.192791137 +0000 UTC m=+60.425365160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : configmap references non-existent config key: service-ca.crt Sep 17 18:40:03.692844 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:03.692843 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:04.192832704 +0000 UTC m=+60.425406713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : secret "router-metrics-certs-default" not found Sep 17 18:40:03.695851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.695826 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-default-certificate\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.695932 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.695862 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-stats-auth\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.702756 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.702728 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb7tm\" (UniqueName: \"kubernetes.io/projected/6a996323-0a99-46cf-9c16-60932faa1015-kube-api-access-tb7tm\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:03.766889 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.766853 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:03.794060 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.794031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwd58\" (UniqueName: \"kubernetes.io/projected/8514c6da-d925-424d-a11d-7874566241b1-kube-api-access-cwd58\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.794216 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.794106 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8514c6da-d925-424d-a11d-7874566241b1-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.794216 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.794160 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.794315 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.794223 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4p2k\" (UniqueName: \"kubernetes.io/projected/1b07205e-a3bc-492d-a02f-53974766a4fc-kube-api-access-g4p2k\") pod \"volume-data-source-validator-5c4db8bdf9-qr9pk\" (UID: \"1b07205e-a3bc-492d-a02f-53974766a4fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" Sep 17 18:40:03.794357 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:03.794313 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:03.794390 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:03.794378 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls podName:8514c6da-d925-424d-a11d-7874566241b1 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:04.294360071 +0000 UTC m=+60.526934074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-lwtwc" (UID: "8514c6da-d925-424d-a11d-7874566241b1") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:03.794838 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.794820 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8514c6da-d925-424d-a11d-7874566241b1-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.802967 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.802951 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwd58\" (UniqueName: \"kubernetes.io/projected/8514c6da-d925-424d-a11d-7874566241b1-kube-api-access-cwd58\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:03.894618 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.894589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4p2k\" (UniqueName: \"kubernetes.io/projected/1b07205e-a3bc-492d-a02f-53974766a4fc-kube-api-access-g4p2k\") pod \"volume-data-source-validator-5c4db8bdf9-qr9pk\" (UID: \"1b07205e-a3bc-492d-a02f-53974766a4fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" Sep 17 18:40:03.903174 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.903155 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4p2k\" (UniqueName: \"kubernetes.io/projected/1b07205e-a3bc-492d-a02f-53974766a4fc-kube-api-access-g4p2k\") pod \"volume-data-source-validator-5c4db8bdf9-qr9pk\" (UID: \"1b07205e-a3bc-492d-a02f-53974766a4fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" Sep 17 18:40:03.928083 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:03.928065 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" Sep 17 18:40:04.195824 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.195795 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk"] Sep 17 18:40:04.197169 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.197149 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:04.197246 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.197181 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:04.197301 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:04.197287 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 18:40:04.197369 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:04.197351 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:05.197329981 +0000 UTC m=+61.429904001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : configmap references non-existent config key: service-ca.crt Sep 17 18:40:04.197435 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:04.197405 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:05.197389628 +0000 UTC m=+61.429963632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : secret "router-metrics-certs-default" not found Sep 17 18:40:04.200324 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:04.200300 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b07205e_a3bc_492d_a02f_53974766a4fc.slice/crio-d003deda6fe5ec1d74e87b070d84160b978afd1a648cb87559ea48ba9387ebc4 WatchSource:0}: Error finding container d003deda6fe5ec1d74e87b070d84160b978afd1a648cb87559ea48ba9387ebc4: Status 404 returned error can't find the container with id d003deda6fe5ec1d74e87b070d84160b978afd1a648cb87559ea48ba9387ebc4 Sep 17 18:40:04.289537 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.289467 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9tc" Sep 17 18:40:04.297902 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.297879 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:04.298040 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:04.298027 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:04.298095 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:04.298085 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls podName:8514c6da-d925-424d-a11d-7874566241b1 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:05.29806813 +0000 UTC m=+61.530642146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-lwtwc" (UID: "8514c6da-d925-424d-a11d-7874566241b1") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:04.362885 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.362861 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" event={"ID":"1b07205e-a3bc-492d-a02f-53974766a4fc","Type":"ContainerStarted","Data":"d003deda6fe5ec1d74e87b070d84160b978afd1a648cb87559ea48ba9387ebc4"} Sep 17 18:40:04.477157 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.477122 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:04.585159 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:04.585063 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:05.205581 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:05.205546 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:05.205743 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:05.205592 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:05.205823 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:05.205742 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:07.205716217 +0000 UTC m=+63.438290235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : configmap references non-existent config key: service-ca.crt Sep 17 18:40:05.205868 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:05.205825 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 18:40:05.205909 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:05.205900 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:07.205881931 +0000 UTC m=+63.438455936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : secret "router-metrics-certs-default" not found Sep 17 18:40:05.306406 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:05.306367 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:05.306570 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:05.306493 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:05.306570 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:05.306560 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls podName:8514c6da-d925-424d-a11d-7874566241b1 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:07.306544312 +0000 UTC m=+63.539118314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-lwtwc" (UID: "8514c6da-d925-424d-a11d-7874566241b1") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:06.369253 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:06.369216 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" event={"ID":"1b07205e-a3bc-492d-a02f-53974766a4fc","Type":"ContainerStarted","Data":"36285544d61050e1294680366e0ea2fb594c725793f51ee2a6e248ae9da38c4f"} Sep 17 18:40:06.390001 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:06.389956 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-qr9pk" podStartSLOduration=2.225335262 podStartE2EDuration="3.389943202s" totalImagesPullingTime="1.16460794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:06.389541584 +0000 UTC m=+62.622115610" watchObservedRunningTime="2026-09-17 18:40:06.389943202 +0000 UTC m=+62.622517244" Sep 17 18:40:06.489869 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:06.489848 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:07.223554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:07.223522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:07.223554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:07.223556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:07.223789 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:07.223662 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 18:40:07.223789 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:07.223687 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:11.223669196 +0000 UTC m=+67.456243200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : configmap references non-existent config key: service-ca.crt Sep 17 18:40:07.223789 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:07.223708 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:11.223701037 +0000 UTC m=+67.456275040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : secret "router-metrics-certs-default" not found Sep 17 18:40:07.324387 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:07.324357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:07.324515 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:07.324466 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:07.324556 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:07.324516 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls podName:8514c6da-d925-424d-a11d-7874566241b1 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:11.324501096 +0000 UTC m=+67.557075099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-lwtwc" (UID: "8514c6da-d925-424d-a11d-7874566241b1") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:08.306618 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.306584 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2wnd4"] Sep 17 18:40:08.308686 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.308664 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.311225 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.311199 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 18:40:08.311907 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.311887 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 18:40:08.311907 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.311898 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 18:40:08.312082 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.311924 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vr4zj\"" Sep 17 18:40:08.312082 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.311894 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 18:40:08.314258 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.314210 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:08.364549 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.364524 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wnd4"] Sep 17 18:40:08.432825 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.432796 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d5e8df7-6423-4589-b406-b67cfd1805b0-crio-socket\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.432985 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.432836 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d5e8df7-6423-4589-b406-b67cfd1805b0-data-volume\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.432985 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.432924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.433056 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.432982 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.433056 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.433013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrfs\" (UniqueName: \"kubernetes.io/projected/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-api-access-qrrfs\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.484246 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.484214 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:08.534336 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534306 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.534457 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534339 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.534457 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534371 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrfs\" (UniqueName: \"kubernetes.io/projected/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-api-access-qrrfs\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.534457 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:08.534430 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:40:08.534560 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:08.534466 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:40:08.534560 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:08.534486 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:09.034470776 +0000 UTC m=+65.267044810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : configmap "kube-rbac-proxy" not found Sep 17 18:40:08.534560 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:08.534515 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:09.034501339 +0000 UTC m=+65.267075343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : secret "insights-runtime-extractor-tls" not found Sep 17 18:40:08.534560 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d5e8df7-6423-4589-b406-b67cfd1805b0-crio-socket\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.534685 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d5e8df7-6423-4589-b406-b67cfd1805b0-data-volume\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.534685 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534658 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d5e8df7-6423-4589-b406-b67cfd1805b0-crio-socket\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.534894 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.534880 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d5e8df7-6423-4589-b406-b67cfd1805b0-data-volume\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.548263 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.548236 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrfs\" (UniqueName: \"kubernetes.io/projected/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-api-access-qrrfs\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:08.578687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.578616 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:08.679722 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.679701 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:08.998814 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:08.998781 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:09.037941 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.037915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:09.038013 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.037947 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:09.038050 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:09.038030 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:40:09.038050 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:09.038040 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:40:09.038117 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:09.038087 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.038073935 +0000 UTC m=+66.270647938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : secret "insights-runtime-extractor-tls" not found Sep 17 18:40:09.038117 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:09.038101 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.0380951 +0000 UTC m=+66.270669103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : configmap "kube-rbac-proxy" not found Sep 17 18:40:09.099094 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.099070 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:09.222182 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.222151 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:09.293096 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.293021 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:09.602382 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.602309 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:09.703596 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.703570 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:09.806698 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:09.806674 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:10.046819 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.046787 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:10.046974 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.046827 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:10.046974 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.046912 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:40:10.046974 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.046950 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:40:10.047076 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.046976 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:12.046959656 +0000 UTC m=+68.279533659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : configmap "kube-rbac-proxy" not found Sep 17 18:40:10.047076 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.046990 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:12.046983969 +0000 UTC m=+68.279557972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : secret "insights-runtime-extractor-tls" not found Sep 17 18:40:10.147502 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.147474 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:40:10.147661 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.147610 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:40:10.147707 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.147662 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls podName:531f734e-7128-4036-ba93-4b83442841b4 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:42.147649336 +0000 UTC m=+98.380223367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls") pod "dns-default-vs6h9" (UID: "531f734e-7128-4036-ba93-4b83442841b4") : secret "dns-default-metrics-tls" not found Sep 17 18:40:10.452389 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.452368 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqw9r_bcd8807d-feac-49a0-a8ad-9a106f894cf3/dns-node-resolver/0.log" Sep 17 18:40:10.653157 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.653132 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:40:10.653448 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.653205 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:40:10.655811 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.655785 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 18:40:10.656764 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.656237 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 18:40:10.663523 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.663503 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 18:40:10.663633 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:10.663582 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs podName:66bf0137-1227-44aa-a252-3dfaea381b1f nodeName:}" failed. No retries permitted until 2026-09-17 18:41:14.66355089 +0000 UTC m=+130.896124904 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs") pod "network-metrics-daemon-tzrr8" (UID: "66bf0137-1227-44aa-a252-3dfaea381b1f") : secret "metrics-daemon-secret" not found Sep 17 18:40:10.665609 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.665590 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18d54f5d-bdbe-4c39-8a52-15b7075ef194-original-pull-secret\") pod \"global-pull-secret-syncer-4jzqs\" (UID: \"18d54f5d-bdbe-4c39-8a52-15b7075ef194\") " pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:40:10.753848 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.753795 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:40:10.756308 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.756289 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 18:40:10.766289 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.766268 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 18:40:10.777133 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.777111 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wp75\" (UniqueName: \"kubernetes.io/projected/e25a1940-8018-4b12-9f2e-3da21ee6fd9a-kube-api-access-4wp75\") pod \"network-check-target-vq7nq\" (UID: \"e25a1940-8018-4b12-9f2e-3da21ee6fd9a\") " pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:40:10.783888 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.783871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jzqs" Sep 17 18:40:10.798695 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.798677 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shgtw\"" Sep 17 18:40:10.806654 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:10.806641 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:40:11.080146 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.079999 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jzqs"] Sep 17 18:40:11.084581 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:11.084556 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d54f5d_bdbe_4c39_8a52_15b7075ef194.slice/crio-37462fa5e4d7d6f9f5d591398a6fa36644128a3b1cfa2d87f1019d85adf7a934 WatchSource:0}: Error finding container 37462fa5e4d7d6f9f5d591398a6fa36644128a3b1cfa2d87f1019d85adf7a934: Status 404 returned error can't find the container with id 37462fa5e4d7d6f9f5d591398a6fa36644128a3b1cfa2d87f1019d85adf7a934 Sep 17 18:40:11.105966 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.105942 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vq7nq"] Sep 17 18:40:11.110844 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:11.110825 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25a1940_8018_4b12_9f2e_3da21ee6fd9a.slice/crio-489ac94c8625dcf281d23968e7ce7127ac5bb97ba311d0787d343285dc739b34 WatchSource:0}: Error finding container 489ac94c8625dcf281d23968e7ce7127ac5bb97ba311d0787d343285dc739b34: Status 404 returned error can't find the container with id 489ac94c8625dcf281d23968e7ce7127ac5bb97ba311d0787d343285dc739b34 Sep 17 18:40:11.256876 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.256853 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:11.257034 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.256881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:11.257034 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:11.257004 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 18:40:11.257034 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:11.257009 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:19.256993055 +0000 UTC m=+75.489567078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : configmap references non-existent config key: service-ca.crt Sep 17 18:40:11.257199 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:11.257040 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:19.257028622 +0000 UTC m=+75.489602626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : secret "router-metrics-certs-default" not found Sep 17 18:40:11.273963 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.273942 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9bc7x"] Sep 17 18:40:11.310194 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.310172 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9bc7x"] Sep 17 18:40:11.310277 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.310250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.313815 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.313796 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 18:40:11.313898 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.313832 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 18:40:11.314305 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.314285 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wfdj6\"" Sep 17 18:40:11.314403 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.314335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 18:40:11.314403 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.314383 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 18:40:11.358216 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.358160 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-signing-key\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.358216 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.358190 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr6n9\" (UniqueName: \"kubernetes.io/projected/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-kube-api-access-nr6n9\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.358402 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.358217 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-signing-cabundle\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.358402 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.358280 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:11.358402 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:11.358384 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:11.358499 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:11.358434 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls podName:8514c6da-d925-424d-a11d-7874566241b1 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:19.358417595 +0000 UTC m=+75.590991598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-lwtwc" (UID: "8514c6da-d925-424d-a11d-7874566241b1") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:11.382376 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.382355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jzqs" event={"ID":"18d54f5d-bdbe-4c39-8a52-15b7075ef194","Type":"ContainerStarted","Data":"37462fa5e4d7d6f9f5d591398a6fa36644128a3b1cfa2d87f1019d85adf7a934"} Sep 17 18:40:11.383445 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.383420 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vq7nq" event={"ID":"e25a1940-8018-4b12-9f2e-3da21ee6fd9a","Type":"ContainerStarted","Data":"489ac94c8625dcf281d23968e7ce7127ac5bb97ba311d0787d343285dc739b34"} Sep 17 18:40:11.407782 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.407741 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:11.449815 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.449793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq4qh_86c0d143-f169-4d57-9e63-a38a05dfa978/node-ca/0.log" Sep 17 18:40:11.459031 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.459010 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-signing-key\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.459111 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.459035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr6n9\" (UniqueName: \"kubernetes.io/projected/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-kube-api-access-nr6n9\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.459111 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.459056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-signing-cabundle\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.459650 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.459633 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-signing-cabundle\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.461304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.461286 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-signing-key\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.468089 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.468069 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr6n9\" (UniqueName: \"kubernetes.io/projected/3ca465dc-f5a1-49e2-b158-4f54dfb2a181-kube-api-access-nr6n9\") pod \"service-ca-55f6fc7b86-9bc7x\" (UID: \"3ca465dc-f5a1-49e2-b158-4f54dfb2a181\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.512432 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.512413 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:11.619109 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.618854 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" Sep 17 18:40:11.707851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.707824 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:11.807546 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.807496 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:11.850037 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.849983 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k7ncr_40341bcb-836b-4800-b641-591c8e03e648/serve-healthcheck-canary/0.log" Sep 17 18:40:11.919980 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:11.919912 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9bc7x"] Sep 17 18:40:11.924269 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:11.924239 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca465dc_f5a1_49e2_b158_4f54dfb2a181.slice/crio-770d78d1543d715984ae44863411522427147f2a47ad5b8c7b06aee22ffae9a7 WatchSource:0}: Error finding container 770d78d1543d715984ae44863411522427147f2a47ad5b8c7b06aee22ffae9a7: Status 404 returned error can't find the container with id 770d78d1543d715984ae44863411522427147f2a47ad5b8c7b06aee22ffae9a7 Sep 17 18:40:12.064031 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:12.063999 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:12.064177 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:12.064039 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:12.064177 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:12.064140 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:40:12.064177 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:12.064174 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:40:12.064345 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:12.064219 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:16.064198427 +0000 UTC m=+72.296772436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : configmap "kube-rbac-proxy" not found Sep 17 18:40:12.064345 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:12.064243 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:16.064232627 +0000 UTC m=+72.296806630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : secret "insights-runtime-extractor-tls" not found Sep 17 18:40:12.388174 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:12.388134 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" event={"ID":"3ca465dc-f5a1-49e2-b158-4f54dfb2a181","Type":"ContainerStarted","Data":"770d78d1543d715984ae44863411522427147f2a47ad5b8c7b06aee22ffae9a7"} Sep 17 18:40:12.659328 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:12.659246 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:16.093864 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.093832 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:16.094242 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.093886 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:16.094242 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:16.093958 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:40:16.094242 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:16.094025 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:24.094005691 +0000 UTC m=+80.326579713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : configmap "kube-rbac-proxy" not found Sep 17 18:40:16.094242 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:16.094029 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:40:16.094242 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:16.094088 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:24.094070469 +0000 UTC m=+80.326644488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : secret "insights-runtime-extractor-tls" not found Sep 17 18:40:16.402081 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.401985 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vq7nq" event={"ID":"e25a1940-8018-4b12-9f2e-3da21ee6fd9a","Type":"ContainerStarted","Data":"e404f7a88fb11ca38cef910101ddd55fc9178490f10b951e84d9da892a11341c"} Sep 17 18:40:16.402081 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.402043 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:40:16.403543 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.403517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" event={"ID":"3ca465dc-f5a1-49e2-b158-4f54dfb2a181","Type":"ContainerStarted","Data":"fdfebc072c4e5981c4e6a164eccb899085eb86a0a247319252101b5716fabde2"} Sep 17 18:40:16.405038 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.405011 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jzqs" event={"ID":"18d54f5d-bdbe-4c39-8a52-15b7075ef194","Type":"ContainerStarted","Data":"a26bdb8afc36422e8ddec59d88c25215fa675e6168a60e5ff259906827b1d526"} Sep 17 18:40:16.420833 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.420781 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vq7nq" podStartSLOduration=65.540256559 podStartE2EDuration="1m10.420765421s" totalImagesPullingTime="4.880508862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:16.419975376 +0000 UTC m=+72.652549403" watchObservedRunningTime="2026-09-17 18:40:16.420765421 +0000 UTC m=+72.653339441" Sep 17 18:40:16.439962 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.439923 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4jzqs" podStartSLOduration=65.512685167 podStartE2EDuration="1m10.439908829s" totalImagesPullingTime="4.927223662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:16.439529929 +0000 UTC m=+72.672103967" watchObservedRunningTime="2026-09-17 18:40:16.439908829 +0000 UTC m=+72.672482853" Sep 17 18:40:16.460950 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:16.460907 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-9bc7x" podStartSLOduration=1.389456763 podStartE2EDuration="5.460895256s" totalImagesPullingTime="4.071438493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:16.459385573 +0000 UTC m=+72.691959598" watchObservedRunningTime="2026-09-17 18:40:16.460895256 +0000 UTC m=+72.693469280" Sep 17 18:40:17.964728 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:17.964612 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:18.245648 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:18.245562 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:18.341420 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:18.341391 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:18.449356 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:18.449323 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:18.883335 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:18.883306 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:19.146388 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:19.146305 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:19.324242 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:19.324208 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:19.324242 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:19.324238 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:19.324418 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:19.324338 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 18:40:19.324418 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:19.324368 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:35.324350698 +0000 UTC m=+91.556924701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : configmap references non-existent config key: service-ca.crt Sep 17 18:40:19.324418 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:19.324392 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs podName:6a996323-0a99-46cf-9c16-60932faa1015 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:35.324383814 +0000 UTC m=+91.556957816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs") pod "router-default-7c69558c48-czg5x" (UID: "6a996323-0a99-46cf-9c16-60932faa1015") : secret "router-metrics-certs-default" not found Sep 17 18:40:19.424852 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:19.424772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:19.425000 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:19.424888 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:19.425000 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:19.424945 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls podName:8514c6da-d925-424d-a11d-7874566241b1 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:35.424927872 +0000 UTC m=+91.657501875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-lwtwc" (UID: "8514c6da-d925-424d-a11d-7874566241b1") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:40:19.648865 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:19.648834 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:19.856765 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:19.856713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:20.289322 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:20.289295 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:20.452637 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:20.452592 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:20.858607 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:20.858578 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:21.433076 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:21.433036 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:21.505584 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:21.505528 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:21.623843 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:21.623811 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:21.722694 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:21.722670 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:21.922968 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:21.922941 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:22.027210 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:22.027131 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:22.089939 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:22.089912 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:22.434697 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:22.434618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:23.020247 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:23.020216 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:23.426458 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:23.426376 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:23.825767 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:23.825723 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:23.926764 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:23.926691 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:24.142492 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.142419 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:24.163556 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.163531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:24.163635 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.163565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:24.163691 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:24.163656 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:40:24.163739 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:24.163704 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls podName:4d5e8df7-6423-4589-b406-b67cfd1805b0 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:40.163691123 +0000 UTC m=+96.396265126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wnd4" (UID: "4d5e8df7-6423-4589-b406-b67cfd1805b0") : secret "insights-runtime-extractor-tls" not found Sep 17 18:40:24.164103 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.164082 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5e8df7-6423-4589-b406-b67cfd1805b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:24.241252 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.241226 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:24.427220 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.427144 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:24.681286 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.681217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:24.783409 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:24.783378 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:25.033288 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:25.033247 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:25.617817 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:25.617788 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:25.841911 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:25.841874 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:26.017142 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:26.017113 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:26.222557 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:26.222527 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:27.031659 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:27.031624 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:27.431098 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:27.430990 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:27.837771 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:27.837722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.035058 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.035032 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.176350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.176259 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.353653 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.353627 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.454804 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.454760 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.654196 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.654161 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.751811 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.751713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:28.909212 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:28.909181 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:29.113697 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:29.113629 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:29.219195 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:29.219167 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:29.725399 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:29.725371 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:30.111132 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:30.111058 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:30.348854 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:30.348823 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:30.431887 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:30.431818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:30.538552 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:30.538527 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:32.725891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.725861 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z"] Sep 17 18:40:32.728784 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.728767 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.731660 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.731640 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 18:40:32.731780 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.731643 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 18:40:32.732385 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.732367 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 18:40:32.732468 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.732396 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 18:40:32.745300 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.745280 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z"] Sep 17 18:40:32.831408 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.831386 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48pb\" (UniqueName: \"kubernetes.io/projected/f18f3dfc-9ed7-40b7-b73c-5325fb245877-kube-api-access-m48pb\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.831512 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.831468 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f18f3dfc-9ed7-40b7-b73c-5325fb245877-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.831512 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.831499 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f18f3dfc-9ed7-40b7-b73c-5325fb245877-tmp\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.871554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.871531 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:32.932736 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.932713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f18f3dfc-9ed7-40b7-b73c-5325fb245877-tmp\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.932854 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.932769 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48pb\" (UniqueName: \"kubernetes.io/projected/f18f3dfc-9ed7-40b7-b73c-5325fb245877-kube-api-access-m48pb\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.932854 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.932838 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f18f3dfc-9ed7-40b7-b73c-5325fb245877-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.933082 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.933065 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f18f3dfc-9ed7-40b7-b73c-5325fb245877-tmp\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.935184 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.935165 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f18f3dfc-9ed7-40b7-b73c-5325fb245877-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.941473 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.941456 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48pb\" (UniqueName: \"kubernetes.io/projected/f18f3dfc-9ed7-40b7-b73c-5325fb245877-kube-api-access-m48pb\") pod \"klusterlet-addon-workmgr-5bc7f698f4-cgg4z\" (UID: \"f18f3dfc-9ed7-40b7-b73c-5325fb245877\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:32.971173 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:32.971150 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:33.037562 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:33.037513 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:33.307492 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:33.307412 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z"] Sep 17 18:40:33.309922 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:33.309897 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18f3dfc_9ed7_40b7_b73c_5325fb245877.slice/crio-8a5aa97c98a8332b6df379f1a644f2aaf3ef2cc2a8c9a0603e6598982e71189d WatchSource:0}: Error finding container 8a5aa97c98a8332b6df379f1a644f2aaf3ef2cc2a8c9a0603e6598982e71189d: Status 404 returned error can't find the container with id 8a5aa97c98a8332b6df379f1a644f2aaf3ef2cc2a8c9a0603e6598982e71189d Sep 17 18:40:33.459118 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:33.459089 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" event={"ID":"f18f3dfc-9ed7-40b7-b73c-5325fb245877","Type":"ContainerStarted","Data":"8a5aa97c98a8332b6df379f1a644f2aaf3ef2cc2a8c9a0603e6598982e71189d"} Sep 17 18:40:34.352254 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:34.352215 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:35.355969 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.355931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:35.355969 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.355981 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:35.356696 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.356665 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a996323-0a99-46cf-9c16-60932faa1015-service-ca-bundle\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:35.359010 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.358985 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a996323-0a99-46cf-9c16-60932faa1015-metrics-certs\") pod \"router-default-7c69558c48-czg5x\" (UID: \"6a996323-0a99-46cf-9c16-60932faa1015\") " pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:35.456981 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.456942 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:35.459686 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.459655 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8514c6da-d925-424d-a11d-7874566241b1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-lwtwc\" (UID: \"8514c6da-d925-424d-a11d-7874566241b1\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:35.478384 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.478347 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:35.564890 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.564855 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-klngq\"" Sep 17 18:40:35.572546 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.572521 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:35.590120 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.590095 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:35.647260 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.647185 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jtwd6\"" Sep 17 18:40:35.652002 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:35.651977 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" Sep 17 18:40:36.172735 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:36.172693 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc"] Sep 17 18:40:36.174879 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:36.174850 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c69558c48-czg5x"] Sep 17 18:40:37.234500 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:37.234462 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8514c6da_d925_424d_a11d_7874566241b1.slice/crio-275246a263715f568ac2776fdf4c12cfddcef8799f736a8c92558670fe472dd5 WatchSource:0}: Error finding container 275246a263715f568ac2776fdf4c12cfddcef8799f736a8c92558670fe472dd5: Status 404 returned error can't find the container with id 275246a263715f568ac2776fdf4c12cfddcef8799f736a8c92558670fe472dd5 Sep 17 18:40:37.235183 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:37.235163 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a996323_0a99_46cf_9c16_60932faa1015.slice/crio-8c8f02aa66d4247251bcd79ac681e5b1db6fc96aa2fbb70660567990e965164b WatchSource:0}: Error finding container 8c8f02aa66d4247251bcd79ac681e5b1db6fc96aa2fbb70660567990e965164b: Status 404 returned error can't find the container with id 8c8f02aa66d4247251bcd79ac681e5b1db6fc96aa2fbb70660567990e965164b Sep 17 18:40:37.477080 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.477044 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" event={"ID":"f18f3dfc-9ed7-40b7-b73c-5325fb245877","Type":"ContainerStarted","Data":"1c4179e9cf0f67cc0d086c795433a2a4433e96bee27bf433d9e2189e58be5063"} Sep 17 18:40:37.477277 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.477243 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:37.478643 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.478622 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" Sep 17 18:40:37.479050 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.479031 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c69558c48-czg5x" event={"ID":"6a996323-0a99-46cf-9c16-60932faa1015","Type":"ContainerStarted","Data":"b813d8833b7300923827e128d21022065dc8c7c4736a0eced88f575b7d74222e"} Sep 17 18:40:37.479130 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.479071 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c69558c48-czg5x" event={"ID":"6a996323-0a99-46cf-9c16-60932faa1015","Type":"ContainerStarted","Data":"8c8f02aa66d4247251bcd79ac681e5b1db6fc96aa2fbb70660567990e965164b"} Sep 17 18:40:37.480177 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.480158 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" event={"ID":"8514c6da-d925-424d-a11d-7874566241b1","Type":"ContainerStarted","Data":"275246a263715f568ac2776fdf4c12cfddcef8799f736a8c92558670fe472dd5"} Sep 17 18:40:37.525189 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.525119 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc7f698f4-cgg4z" podStartSLOduration=1.5582753440000001 podStartE2EDuration="5.525106297s" totalImagesPullingTime="3.966830953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:37.521953687 +0000 UTC m=+93.754527711" watchObservedRunningTime="2026-09-17 18:40:37.525106297 +0000 UTC m=+93.757680321" Sep 17 18:40:37.548686 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.548631 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c69558c48-czg5x" podStartSLOduration=34.548616527 podStartE2EDuration="34.548616527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:37.548395118 +0000 UTC m=+93.780969143" watchObservedRunningTime="2026-09-17 18:40:37.548616527 +0000 UTC m=+93.781190554" Sep 17 18:40:37.572777 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.572737 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:37.575013 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.574996 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:37.625954 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:37.625934 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:38.483442 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:38.483407 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:38.484957 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:38.484926 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c69558c48-czg5x" Sep 17 18:40:39.079242 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.079156 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:39.197518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.197472 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:39.276442 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.276410 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l"] Sep 17 18:40:39.278320 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.278303 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:39.280640 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.280615 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 18:40:39.280793 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.280696 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bnnhh\"" Sep 17 18:40:39.290131 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.290092 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l"] Sep 17 18:40:39.315393 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.315369 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:39.387633 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.387568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5007c75d-900a-44b4-b55c-4fbd939c4265-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-pwq8l\" (UID: \"5007c75d-900a-44b4-b55c-4fbd939c4265\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:39.421354 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.421326 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:39.487434 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.487400 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" event={"ID":"8514c6da-d925-424d-a11d-7874566241b1","Type":"ContainerStarted","Data":"87fe59a75f3431a04ec4c91bd7f9f8828f6ef4ed5b1bff723ae07e1bb720dfda"} Sep 17 18:40:39.487905 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.487883 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5007c75d-900a-44b4-b55c-4fbd939c4265-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-pwq8l\" (UID: \"5007c75d-900a-44b4-b55c-4fbd939c4265\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:39.490185 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.490161 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5007c75d-900a-44b4-b55c-4fbd939c4265-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-pwq8l\" (UID: \"5007c75d-900a-44b4-b55c-4fbd939c4265\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:39.505060 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.505025 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-lwtwc" podStartSLOduration=35.051272921 podStartE2EDuration="36.505011829s" totalImagesPullingTime="1.453738908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:39.503667318 +0000 UTC m=+95.736241354" watchObservedRunningTime="2026-09-17 18:40:39.505011829 +0000 UTC m=+95.737585853" Sep 17 18:40:39.587241 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.587219 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:39.870612 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:39.870582 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l"] Sep 17 18:40:39.873743 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:39.873719 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5007c75d_900a_44b4_b55c_4fbd939c4265.slice/crio-9390ba6be4a0c165a526d418edb9ad80f80ed7f375c96ea100d73e98c594276e WatchSource:0}: Error finding container 9390ba6be4a0c165a526d418edb9ad80f80ed7f375c96ea100d73e98c594276e: Status 404 returned error can't find the container with id 9390ba6be4a0c165a526d418edb9ad80f80ed7f375c96ea100d73e98c594276e Sep 17 18:40:40.194356 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.194311 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:40.196555 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.196527 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5e8df7-6423-4589-b406-b67cfd1805b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wnd4\" (UID: \"4d5e8df7-6423-4589-b406-b67cfd1805b0\") " pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:40.417666 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.417627 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wnd4" Sep 17 18:40:40.493631 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.493592 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" event={"ID":"5007c75d-900a-44b4-b55c-4fbd939c4265","Type":"ContainerStarted","Data":"9390ba6be4a0c165a526d418edb9ad80f80ed7f375c96ea100d73e98c594276e"} Sep 17 18:40:40.691585 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.691551 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wnd4"] Sep 17 18:40:40.739800 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.739719 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:40.825075 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:40.825041 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5e8df7_6423_4589_b406_b67cfd1805b0.slice/crio-3de367bfdd74e247c70807b50bff336a6dbcc6ddb5a06ab3256e22000d9a6379 WatchSource:0}: Error finding container 3de367bfdd74e247c70807b50bff336a6dbcc6ddb5a06ab3256e22000d9a6379: Status 404 returned error can't find the container with id 3de367bfdd74e247c70807b50bff336a6dbcc6ddb5a06ab3256e22000d9a6379 Sep 17 18:40:40.840135 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:40.840112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:41.497731 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.497705 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" event={"ID":"5007c75d-900a-44b4-b55c-4fbd939c4265","Type":"ContainerStarted","Data":"8bc76699e9ec4eeee5e8c70413a1a2b643b9f5a63d125f9c886423dd148d16b5"} Sep 17 18:40:41.498071 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.497775 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:41.499872 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.499848 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wnd4" event={"ID":"4d5e8df7-6423-4589-b406-b67cfd1805b0","Type":"ContainerStarted","Data":"814b3d22b2f0540303263d4d58ff0a1076492ffa3aaa26191b5b9716ebae1946"} Sep 17 18:40:41.499953 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.499904 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wnd4" event={"ID":"4d5e8df7-6423-4589-b406-b67cfd1805b0","Type":"ContainerStarted","Data":"c2afde543f11f73a07aa4dae1de39d13a931eb7b445eba20a3dc91aa1fa1579a"} Sep 17 18:40:41.499953 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.499934 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wnd4" event={"ID":"4d5e8df7-6423-4589-b406-b67cfd1805b0","Type":"ContainerStarted","Data":"3de367bfdd74e247c70807b50bff336a6dbcc6ddb5a06ab3256e22000d9a6379"} Sep 17 18:40:41.502978 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.502962 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" Sep 17 18:40:41.518053 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:41.518015 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pwq8l" podStartSLOduration=1.546737995 podStartE2EDuration="2.518001268s" totalImagesPullingTime="971.263273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:41.516965941 +0000 UTC m=+97.749539990" watchObservedRunningTime="2026-09-17 18:40:41.518001268 +0000 UTC m=+97.750575293" Sep 17 18:40:42.209360 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.209323 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:40:42.211912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.211880 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/531f734e-7128-4036-ba93-4b83442841b4-metrics-tls\") pod \"dns-default-vs6h9\" (UID: \"531f734e-7128-4036-ba93-4b83442841b4\") " pod="openshift-dns/dns-default-vs6h9" Sep 17 18:40:42.241852 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.241822 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f9x8j\"" Sep 17 18:40:42.250278 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.250250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vs6h9" Sep 17 18:40:42.320772 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.320718 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:42.365416 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.365380 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-8srln"] Sep 17 18:40:42.368078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.368054 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.370558 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.370530 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 18:40:42.370675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.370563 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 18:40:42.370675 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.370639 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hwpmz\"" Sep 17 18:40:42.371436 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.371413 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 18:40:42.379483 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.379455 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-8srln"] Sep 17 18:40:42.409621 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.409592 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:42.511009 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.510921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.511427 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.511034 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.511427 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.511087 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcfd\" (UniqueName: \"kubernetes.io/projected/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-kube-api-access-vfcfd\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.511427 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.511110 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.526851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.526826 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:42.539774 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.539667 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vs6h9"] Sep 17 18:40:42.611915 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.611880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.612074 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.611963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.612074 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.611993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcfd\" (UniqueName: \"kubernetes.io/projected/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-kube-api-access-vfcfd\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.612074 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.612010 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.612718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.612693 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.614987 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.614964 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.615091 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.615057 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.621774 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.621736 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcfd\" (UniqueName: \"kubernetes.io/projected/9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5-kube-api-access-vfcfd\") pod \"prometheus-operator-7bd5d56d6-8srln\" (UID: \"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.677503 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:42.677476 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531f734e_7128_4036_ba93_4b83442841b4.slice/crio-b477703bd3b20ef6c3d97e04059e5d21208f41bb5caf39981666362a573118b7 WatchSource:0}: Error finding container b477703bd3b20ef6c3d97e04059e5d21208f41bb5caf39981666362a573118b7: Status 404 returned error can't find the container with id b477703bd3b20ef6c3d97e04059e5d21208f41bb5caf39981666362a573118b7 Sep 17 18:40:42.679368 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.679350 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" Sep 17 18:40:42.951671 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.951638 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:42.961426 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:42.961405 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-8srln"] Sep 17 18:40:42.963676 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:42.963646 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8d5389_32a9_4d8f_ab4b_ebae4e7c1fc5.slice/crio-8bca7502738f23379e7378a55ca02f7eff9c96d29c3e7829a7d2329181a57481 WatchSource:0}: Error finding container 8bca7502738f23379e7378a55ca02f7eff9c96d29c3e7829a7d2329181a57481: Status 404 returned error can't find the container with id 8bca7502738f23379e7378a55ca02f7eff9c96d29c3e7829a7d2329181a57481 Sep 17 18:40:43.055366 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:43.055271 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:43.509462 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:43.509424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wnd4" event={"ID":"4d5e8df7-6423-4589-b406-b67cfd1805b0","Type":"ContainerStarted","Data":"d7a9a1b7c72ccaac4f8047c2b4bdafc188243279964caf09eb621abba8ee3b7c"} Sep 17 18:40:43.510667 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:43.510639 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vs6h9" event={"ID":"531f734e-7128-4036-ba93-4b83442841b4","Type":"ContainerStarted","Data":"b477703bd3b20ef6c3d97e04059e5d21208f41bb5caf39981666362a573118b7"} Sep 17 18:40:43.511972 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:43.511943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" event={"ID":"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5","Type":"ContainerStarted","Data":"8bca7502738f23379e7378a55ca02f7eff9c96d29c3e7829a7d2329181a57481"} Sep 17 18:40:43.529142 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:43.529094 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2wnd4" podStartSLOduration=33.760077562 podStartE2EDuration="35.529079415s" totalImagesPullingTime="1.769001853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:40:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:43.526917695 +0000 UTC m=+99.759491747" watchObservedRunningTime="2026-09-17 18:40:43.529079415 +0000 UTC m=+99.761653446" Sep 17 18:40:44.517428 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:44.517389 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vs6h9" event={"ID":"531f734e-7128-4036-ba93-4b83442841b4","Type":"ContainerStarted","Data":"5208e545745fe71eea4c036a4ce3c3a578f2fdf53c4264dc7d42c1aa67c48dcd"} Sep 17 18:40:44.517881 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:44.517450 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vs6h9" event={"ID":"531f734e-7128-4036-ba93-4b83442841b4","Type":"ContainerStarted","Data":"4563c2fdb2342564331bd17dfc67fe74547e4def2367af764201b98c8835e7e0"} Sep 17 18:40:44.517881 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:44.517743 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vs6h9" Sep 17 18:40:44.536353 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:44.536308 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vs6h9" podStartSLOduration=65.203024388 podStartE2EDuration="1m6.536295619s" totalImagesPullingTime="1.333271231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:44.534565555 +0000 UTC m=+100.767139580" watchObservedRunningTime="2026-09-17 18:40:44.536295619 +0000 UTC m=+100.768869644" Sep 17 18:40:45.063701 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:45.063661 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:45.199596 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:45.199567 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:45.522453 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:45.522364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" event={"ID":"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5","Type":"ContainerStarted","Data":"30e51912bdfc340383c9e7820f6cb28f95889f25fb92bf02abb240fdb2530f70"} Sep 17 18:40:45.522928 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:45.522458 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" event={"ID":"9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5","Type":"ContainerStarted","Data":"6ebc0f963ba9cbf55102d1ecd4c37dc717e97b9d6b088c958f906ef6bc1e148b"} Sep 17 18:40:45.544368 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:45.544319 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-8srln" podStartSLOduration=1.687722708 podStartE2EDuration="3.544306251s" totalImagesPullingTime="1.856583543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:45.543962215 +0000 UTC m=+101.776536241" watchObservedRunningTime="2026-09-17 18:40:45.544306251 +0000 UTC m=+101.776880310" Sep 17 18:40:47.410437 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.410403 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vq7nq" Sep 17 18:40:47.541995 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.541960 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:47.780636 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.780592 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:47.874327 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.874293 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j8wxc"] Sep 17 18:40:47.877646 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.877625 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.880046 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.880026 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 18:40:47.880168 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.880146 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 18:40:47.880302 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.880288 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 18:40:47.880880 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.880861 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l9q9n\"" Sep 17 18:40:47.910809 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.910788 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wt25k"] Sep 17 18:40:47.915075 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.915058 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:47.918833 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.918813 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 18:40:47.918928 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.918823 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 18:40:47.919135 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.919117 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 18:40:47.919249 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.919152 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-svhd8\"" Sep 17 18:40:47.919569 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.919545 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:47.927741 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.927722 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wt25k"] Sep 17 18:40:47.950790 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.950762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.950912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.950800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-textfile\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.950912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.950828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-accelerators-collector-config\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.950912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.950855 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2bk8\" (UniqueName: \"kubernetes.io/projected/7992ff85-f419-45ca-aadd-db63bd2ae03f-kube-api-access-f2bk8\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.950912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.950890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-sys\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.951067 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.950964 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-tls\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.951067 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.951012 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7992ff85-f419-45ca-aadd-db63bd2ae03f-metrics-client-ca\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.951067 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.951037 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-root\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:47.951067 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:47.951060 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-wtmp\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.018378 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.018357 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:48.051552 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051486 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.051552 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-textfile\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.051552 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051542 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-accelerators-collector-config\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2bk8\" (UniqueName: \"kubernetes.io/projected/7992ff85-f419-45ca-aadd-db63bd2ae03f-kube-api-access-f2bk8\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051598 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051622 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c986853c-8e2c-4072-be38-8cc9dc21c506-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-sys\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051686 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpzv6\" (UniqueName: \"kubernetes.io/projected/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-api-access-cpzv6\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051713 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.051744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051736 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-sys\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051798 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-tls\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7992ff85-f419-45ca-aadd-db63bd2ae03f-metrics-client-ca\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051895 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-root\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-wtmp\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051974 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-root\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.051994 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.052001 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-textfile\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052104 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.052047 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c986853c-8e2c-4072-be38-8cc9dc21c506-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.052413 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.052209 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-accelerators-collector-config\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052413 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.052217 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-wtmp\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.052413 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.052352 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7992ff85-f419-45ca-aadd-db63bd2ae03f-metrics-client-ca\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.053987 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.053959 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.054094 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.054077 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7992ff85-f419-45ca-aadd-db63bd2ae03f-node-exporter-tls\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.061946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.061921 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2bk8\" (UniqueName: \"kubernetes.io/projected/7992ff85-f419-45ca-aadd-db63bd2ae03f-kube-api-access-f2bk8\") pod \"node-exporter-j8wxc\" (UID: \"7992ff85-f419-45ca-aadd-db63bd2ae03f\") " pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.127897 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.127857 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:48.153014 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.152982 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.153014 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.153016 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c986853c-8e2c-4072-be38-8cc9dc21c506-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.153228 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.153046 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.153228 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.153064 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c986853c-8e2c-4072-be38-8cc9dc21c506-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.153228 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.153095 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpzv6\" (UniqueName: \"kubernetes.io/projected/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-api-access-cpzv6\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.153228 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.153112 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.153461 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.153431 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c986853c-8e2c-4072-be38-8cc9dc21c506-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.154034 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.154014 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.154138 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.154074 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c986853c-8e2c-4072-be38-8cc9dc21c506-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.155589 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.155561 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.155691 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.155624 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.162768 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.162720 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpzv6\" (UniqueName: \"kubernetes.io/projected/c986853c-8e2c-4072-be38-8cc9dc21c506-kube-api-access-cpzv6\") pod \"kube-state-metrics-84c885658c-wt25k\" (UID: \"c986853c-8e2c-4072-be38-8cc9dc21c506\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.189090 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.189072 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j8wxc" Sep 17 18:40:48.201097 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:48.201073 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7992ff85_f419_45ca_aadd_db63bd2ae03f.slice/crio-55cbc66b16e6baae6c5d43a863af9c5022fdce02b424af90ce21e408f62401c9 WatchSource:0}: Error finding container 55cbc66b16e6baae6c5d43a863af9c5022fdce02b424af90ce21e408f62401c9: Status 404 returned error can't find the container with id 55cbc66b16e6baae6c5d43a863af9c5022fdce02b424af90ce21e408f62401c9 Sep 17 18:40:48.223922 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.223897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" Sep 17 18:40:48.235041 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.235021 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:48.333218 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.333149 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:48.511596 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.511570 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wt25k"] Sep 17 18:40:48.513854 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:48.513831 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc986853c_8e2c_4072_be38_8cc9dc21c506.slice/crio-3e3cea5f9a09928f8aa5ea45f3245ececdbb109e4e7fa623394158983a95af0a WatchSource:0}: Error finding container 3e3cea5f9a09928f8aa5ea45f3245ececdbb109e4e7fa623394158983a95af0a: Status 404 returned error can't find the container with id 3e3cea5f9a09928f8aa5ea45f3245ececdbb109e4e7fa623394158983a95af0a Sep 17 18:40:48.533795 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.533771 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" event={"ID":"c986853c-8e2c-4072-be38-8cc9dc21c506","Type":"ContainerStarted","Data":"3e3cea5f9a09928f8aa5ea45f3245ececdbb109e4e7fa623394158983a95af0a"} Sep 17 18:40:48.534846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:48.534826 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8wxc" event={"ID":"7992ff85-f419-45ca-aadd-db63bd2ae03f","Type":"ContainerStarted","Data":"55cbc66b16e6baae6c5d43a863af9c5022fdce02b424af90ce21e408f62401c9"} Sep 17 18:40:49.017536 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:49.017503 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:49.154338 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:49.154263 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:49.396211 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:49.396121 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:49.547651 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:49.547586 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:49.704078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:49.703984 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:50.299016 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.298995 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:50.452540 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.452510 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:50.546420 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.546382 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" event={"ID":"c986853c-8e2c-4072-be38-8cc9dc21c506","Type":"ContainerStarted","Data":"78b4b56a6814088b776996dcaea3f7e1965209a361485e0b91ea60f62cd92e35"} Sep 17 18:40:50.546549 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.546458 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" event={"ID":"c986853c-8e2c-4072-be38-8cc9dc21c506","Type":"ContainerStarted","Data":"1e44e4b725e2e3d4f61561db08c253a53815340585799647652314c62ff8ce06"} Sep 17 18:40:50.546549 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.546492 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" event={"ID":"c986853c-8e2c-4072-be38-8cc9dc21c506","Type":"ContainerStarted","Data":"778b1287fe535e04dc9f1c78909e784262f62c56afa5733be935d92fd29d3b70"} Sep 17 18:40:50.548809 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.548781 2552 generic.go:356] "Generic (PLEG): container finished" podID="7992ff85-f419-45ca-aadd-db63bd2ae03f" containerID="c3199acf3b0a077d0dcb2e447100345178148590ec670b9b6bc448e3e7263abd" exitCode=0 Sep 17 18:40:50.549146 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.548875 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8wxc" event={"ID":"7992ff85-f419-45ca-aadd-db63bd2ae03f","Type":"ContainerDied","Data":"c3199acf3b0a077d0dcb2e447100345178148590ec670b9b6bc448e3e7263abd"} Sep 17 18:40:50.592603 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:50.592560 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-wt25k" podStartSLOduration=1.9042332960000001 podStartE2EDuration="3.592546387s" totalImagesPullingTime="1.688313091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:50.590365868 +0000 UTC m=+106.822939894" watchObservedRunningTime="2026-09-17 18:40:50.592546387 +0000 UTC m=+106.825120409" Sep 17 18:40:51.101700 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.101614 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw"] Sep 17 18:40:51.113932 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.113904 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.118192 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.118169 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 18:40:51.118328 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.118192 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 18:40:51.118482 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.118468 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 18:40:51.118936 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.118916 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 18:40:51.119155 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.119139 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 18:40:51.119240 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.119139 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dn88t\"" Sep 17 18:40:51.119240 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.119145 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1vcc0es0ntcah\"" Sep 17 18:40:51.124634 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.124613 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw"] Sep 17 18:40:51.284068 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284037 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-metrics-client-ca\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284271 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284075 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-tls\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284271 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284271 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284122 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284435 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284260 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-grpc-tls\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284435 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284303 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jm8\" (UniqueName: \"kubernetes.io/projected/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-kube-api-access-n4jm8\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284435 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.284435 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.284411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.317087 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.317058 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:51.385359 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385359 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385324 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385361 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-metrics-client-ca\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385381 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-tls\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385429 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385484 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-grpc-tls\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.385588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.385512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jm8\" (UniqueName: \"kubernetes.io/projected/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-kube-api-access-n4jm8\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.386554 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.386526 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-metrics-client-ca\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.388603 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.388558 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.388715 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.388601 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.388922 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.388896 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-grpc-tls\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.388922 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.388915 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.389242 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.389222 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-tls\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.389386 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.389369 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.402926 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.402904 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jm8\" (UniqueName: \"kubernetes.io/projected/cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b-kube-api-access-n4jm8\") pod \"thanos-querier-7c8f64dc6b-s7lrw\" (UID: \"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b\") " pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.423691 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.423673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:51.425829 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.425807 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:51.557041 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.556804 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8wxc" event={"ID":"7992ff85-f419-45ca-aadd-db63bd2ae03f","Type":"ContainerStarted","Data":"b3eefadddbd3ec2d607a27eb28447717ff2acee5ca69a08fef7239a181a5f829"} Sep 17 18:40:51.557041 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.556860 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j8wxc" event={"ID":"7992ff85-f419-45ca-aadd-db63bd2ae03f","Type":"ContainerStarted","Data":"03b9b523c4b128f23b3f26bf6d25b1db05c4823da8c59073cce767707c07e8ec"} Sep 17 18:40:51.586637 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.586579 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j8wxc" podStartSLOduration=2.50579108 podStartE2EDuration="4.586560039s" totalImagesPullingTime="1.99889808s" totalInitContainerRuntime="81.870879ms" isStatefulPod=true podCreationTimestamp="2026-09-17 18:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:51.584950019 +0000 UTC m=+107.817524059" watchObservedRunningTime="2026-09-17 18:40:51.586560039 +0000 UTC m=+107.819134066" Sep 17 18:40:51.686111 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.686025 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:51.730951 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.730868 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw"] Sep 17 18:40:51.733740 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:51.733713 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbdd9212_df5c_4e6b_ba3e_5ab0f902aa5b.slice/crio-6f812fdd372d54b41aea0f32a3d1516e9bdfd9a0c325df7a7cb5d33c0a54230d WatchSource:0}: Error finding container 6f812fdd372d54b41aea0f32a3d1516e9bdfd9a0c325df7a7cb5d33c0a54230d: Status 404 returned error can't find the container with id 6f812fdd372d54b41aea0f32a3d1516e9bdfd9a0c325df7a7cb5d33c0a54230d Sep 17 18:40:51.947077 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:51.947035 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:52.247063 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.246982 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-794546dc68-788bd"] Sep 17 18:40:52.260062 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.260038 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.263334 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.263316 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 18:40:52.264601 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.264582 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 18:40:52.265062 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.265043 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 18:40:52.265885 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.265649 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9nkgravheblp2\"" Sep 17 18:40:52.265885 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.265709 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 18:40:52.266196 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.266174 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nb4pg\"" Sep 17 18:40:52.274519 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.274497 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-794546dc68-788bd"] Sep 17 18:40:52.392933 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.392900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-audit-log\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.393094 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.392955 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-secret-metrics-server-client-certs\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.393094 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.393011 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-metrics-server-audit-profiles\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.393094 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.393045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-secret-metrics-server-tls\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.393094 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.393089 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chhd\" (UniqueName: \"kubernetes.io/projected/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-kube-api-access-2chhd\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.393221 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.393112 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.393221 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.393161 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-client-ca-bundle\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494336 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chhd\" (UniqueName: \"kubernetes.io/projected/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-kube-api-access-2chhd\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494336 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494336 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494573 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-client-ca-bundle\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494573 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494419 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-audit-log\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494573 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494458 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-secret-metrics-server-client-certs\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494573 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494485 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-metrics-server-audit-profiles\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494809 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494711 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-secret-metrics-server-tls\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.494933 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.494911 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-audit-log\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.495293 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.495272 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.495664 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.495639 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-metrics-server-audit-profiles\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.497407 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.497349 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-secret-metrics-server-client-certs\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.497407 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.497383 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-secret-metrics-server-tls\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.497737 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.497716 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-client-ca-bundle\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.506504 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.506475 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chhd\" (UniqueName: \"kubernetes.io/projected/ac1e939a-bb7e-448c-ae12-56dd264e6f6b-kube-api-access-2chhd\") pod \"metrics-server-794546dc68-788bd\" (UID: \"ac1e939a-bb7e-448c-ae12-56dd264e6f6b\") " pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.560350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.560283 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:52.562480 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.562450 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"6f812fdd372d54b41aea0f32a3d1516e9bdfd9a0c325df7a7cb5d33c0a54230d"} Sep 17 18:40:52.574142 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.574121 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:40:52.607380 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.607357 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw"] Sep 17 18:40:52.629285 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.629255 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:52.632879 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.632859 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pfhlz\"" Sep 17 18:40:52.633708 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.633243 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 18:40:52.641975 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.641866 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw"] Sep 17 18:40:52.683977 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.683948 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:52.798131 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.798044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1871c97-a38e-48b4-8ece-78f384bff4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:52.798131 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.798084 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25zjl\" (UniqueName: \"kubernetes.io/projected/b1871c97-a38e-48b4-8ece-78f384bff4d5-kube-api-access-25zjl\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:52.899171 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.899126 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1871c97-a38e-48b4-8ece-78f384bff4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:52.899342 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.899176 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25zjl\" (UniqueName: \"kubernetes.io/projected/b1871c97-a38e-48b4-8ece-78f384bff4d5-kube-api-access-25zjl\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:52.899342 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:52.899266 2552 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 18:40:52.899342 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:40:52.899338 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1871c97-a38e-48b4-8ece-78f384bff4d5-monitoring-plugin-cert podName:b1871c97-a38e-48b4-8ece-78f384bff4d5 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:53.399314807 +0000 UTC m=+109.631888811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b1871c97-a38e-48b4-8ece-78f384bff4d5-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-h5kqw" (UID: "b1871c97-a38e-48b4-8ece-78f384bff4d5") : secret "monitoring-plugin-cert" not found Sep 17 18:40:52.905184 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.905157 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-794546dc68-788bd"] Sep 17 18:40:52.909017 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:52.908995 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1e939a_bb7e_448c_ae12_56dd264e6f6b.slice/crio-6c7afa483f597adfe8cde8d2f67b1895c0d2efad069e06097fb04b73eed11cc5 WatchSource:0}: Error finding container 6c7afa483f597adfe8cde8d2f67b1895c0d2efad069e06097fb04b73eed11cc5: Status 404 returned error can't find the container with id 6c7afa483f597adfe8cde8d2f67b1895c0d2efad069e06097fb04b73eed11cc5 Sep 17 18:40:52.912942 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:52.912919 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25zjl\" (UniqueName: \"kubernetes.io/projected/b1871c97-a38e-48b4-8ece-78f384bff4d5-kube-api-access-25zjl\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:53.104064 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.103990 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:53.342886 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.342845 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:53.404410 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.404327 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1871c97-a38e-48b4-8ece-78f384bff4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:53.407550 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.407499 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1871c97-a38e-48b4-8ece-78f384bff4d5-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h5kqw\" (UID: \"b1871c97-a38e-48b4-8ece-78f384bff4d5\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:53.477293 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.477256 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:53.549124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.549090 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:53.567513 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.567469 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-794546dc68-788bd" event={"ID":"ac1e939a-bb7e-448c-ae12-56dd264e6f6b","Type":"ContainerStarted","Data":"6c7afa483f597adfe8cde8d2f67b1895c0d2efad069e06097fb04b73eed11cc5"} Sep 17 18:40:53.990116 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:53.990086 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw"] Sep 17 18:40:53.991454 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:53.991425 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1871c97_a38e_48b4_8ece_78f384bff4d5.slice/crio-dde2c1bca350a4070f0ce459e439a76df616ab34ebff84e30c84614e699c91d3 WatchSource:0}: Error finding container dde2c1bca350a4070f0ce459e439a76df616ab34ebff84e30c84614e699c91d3: Status 404 returned error can't find the container with id dde2c1bca350a4070f0ce459e439a76df616ab34ebff84e30c84614e699c91d3 Sep 17 18:40:54.525176 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.525144 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vs6h9" Sep 17 18:40:54.574074 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.574015 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" event={"ID":"b1871c97-a38e-48b4-8ece-78f384bff4d5","Type":"ContainerStarted","Data":"dde2c1bca350a4070f0ce459e439a76df616ab34ebff84e30c84614e699c91d3"} Sep 17 18:40:54.579541 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.579489 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:54.580412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.580382 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"15c467e6a0492353879fbcfac7126b27874c2861c68f514a7cf37401879cd9d0"} Sep 17 18:40:54.580557 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.580457 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"6d3af258e0790a67d26290dbb957693f18e794eee1fcd7e4bc5752e71540ec40"} Sep 17 18:40:54.580557 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.580501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"43077f1cd1869f0a9654d7a4755e68d9f1f0d721bf94527141365a1ff2b1e482"} Sep 17 18:40:54.617204 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.617170 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:40:54.621494 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.621468 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.629620 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.629593 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 18:40:54.630056 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630035 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 18:40:54.630163 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630144 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 18:40:54.630240 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630214 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 18:40:54.630365 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630278 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 18:40:54.630531 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630512 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 18:40:54.630934 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630914 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 18:40:54.631024 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.630949 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 18:40:54.631217 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.631194 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mvhkg\"" Sep 17 18:40:54.631460 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.631436 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 18:40:54.632829 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.632808 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 18:40:54.633378 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.633357 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 18:40:54.633456 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.633383 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4gk6fhgkhj00v\"" Sep 17 18:40:54.633839 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.633672 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 18:40:54.633839 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.633717 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 18:40:54.634668 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.634645 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 18:40:54.644810 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.644781 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:40:54.680684 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.680655 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:54.716149 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716121 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716198 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716224 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8mw\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-kube-api-access-kj8mw\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716393 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716279 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716393 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716470 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716397 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716470 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716470 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716592 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716490 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716592 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716527 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716592 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716557 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716592 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716806 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716806 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716626 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716806 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716664 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.716951 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.717008 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716968 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.717008 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.716998 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.717101 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.717041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.791680 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.791649 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:54.817591 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.817818 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817792 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.817946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817840 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.817946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.817946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817902 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.817946 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817925 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817948 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.817977 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818029 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818067 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818121 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8mw\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-kube-api-access-kj8mw\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818170 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818171 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818564 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818218 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818564 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818268 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818564 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818564 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818564 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818349 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818564 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818390 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.818887 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.818673 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.819229 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.819202 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.819427 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.819304 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.823040 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.823017 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.824606 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.824290 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.825982 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.825273 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.825982 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.825928 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.826434 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.826383 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.827624 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.827576 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.827711 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.827672 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.828174 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.828123 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.828320 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.828288 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.829018 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.828967 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.829124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.829101 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.829705 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.829660 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.829857 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.829775 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.830373 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.830346 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.831730 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.830894 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.832048 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.832025 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.839813 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.839793 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8mw\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-kube-api-access-kj8mw\") pod \"prometheus-k8s-0\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:54.886132 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.886083 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:54.934832 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:54.934606 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:40:55.256977 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.256945 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:40:55.262168 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:40:55.262131 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087856b5_ff1b_41f6_a82c_562e44c2f2dd.slice/crio-09295ef8d3efbb747cbc73cb9c146a9b13fd203253c030b51b7212c6b34370b5 WatchSource:0}: Error finding container 09295ef8d3efbb747cbc73cb9c146a9b13fd203253c030b51b7212c6b34370b5: Status 404 returned error can't find the container with id 09295ef8d3efbb747cbc73cb9c146a9b13fd203253c030b51b7212c6b34370b5 Sep 17 18:40:55.432765 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.432708 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:55.533324 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.533239 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:40:55.587889 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.587856 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"ff802b0e34088da7f01477985a8effea154387091af13ed58c019bbc3f0b82ba"} Sep 17 18:40:55.589642 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.589614 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-794546dc68-788bd" event={"ID":"ac1e939a-bb7e-448c-ae12-56dd264e6f6b","Type":"ContainerStarted","Data":"0e41ffb8919c338b3d3fc3c2e87415ba16ce502576080ff28119240cacf0cd00"} Sep 17 18:40:55.591321 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.591294 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"09295ef8d3efbb747cbc73cb9c146a9b13fd203253c030b51b7212c6b34370b5"} Sep 17 18:40:55.607694 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:55.607638 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-794546dc68-788bd" podStartSLOduration=1.8023816240000001 podStartE2EDuration="3.607624353s" totalImagesPullingTime="1.805242729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:55.606989517 +0000 UTC m=+111.839563585" watchObservedRunningTime="2026-09-17 18:40:55.607624353 +0000 UTC m=+111.840198441" Sep 17 18:40:56.601655 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.601567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"f1f59a8005de2d9b609e568681de892513bd0bca9884bf2ec58a90de85493653"} Sep 17 18:40:56.602078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.601675 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:40:56.602078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.601717 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" event={"ID":"cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b","Type":"ContainerStarted","Data":"55bcd7fb8090342c08a554884ec386a9fe926f8878fd337c107f4672b88f73bd"} Sep 17 18:40:56.603060 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.603032 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55" exitCode=0 Sep 17 18:40:56.603177 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.603114 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55"} Sep 17 18:40:56.604534 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.604510 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" event={"ID":"b1871c97-a38e-48b4-8ece-78f384bff4d5","Type":"ContainerStarted","Data":"1e517457f390e176bfa90cf612096b24f11016ca7c0e257c30f3ec8a39b436f1"} Sep 17 18:40:56.627803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.627738 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" podStartSLOduration=2.275455261 podStartE2EDuration="5.62772262s" totalImagesPullingTime="3.352267359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:56.626413468 +0000 UTC m=+112.858987490" watchObservedRunningTime="2026-09-17 18:40:56.62772262 +0000 UTC m=+112.860296646" Sep 17 18:40:56.644802 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:56.644739 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" podStartSLOduration=2.941542081 podStartE2EDuration="4.644726212s" totalImagesPullingTime="1.703184131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:56.643946352 +0000 UTC m=+112.876520389" watchObservedRunningTime="2026-09-17 18:40:56.644726212 +0000 UTC m=+112.877300241" Sep 17 18:40:57.608819 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:57.608788 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:40:57.613322 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:40:57.613298 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h5kqw" Sep 17 18:41:00.625800 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.625771 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a"} Sep 17 18:41:00.626193 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.625847 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b"} Sep 17 18:41:00.626193 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.625892 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037"} Sep 17 18:41:00.626193 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.625936 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b"} Sep 17 18:41:00.626193 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.625975 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3"} Sep 17 18:41:00.626193 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.626013 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerStarted","Data":"89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c"} Sep 17 18:41:00.659603 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:00.659544 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.635423392 podStartE2EDuration="6.659526605s" totalImagesPullingTime="4.002044965s" totalInitContainerRuntime="22.058248ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:41:00.657700685 +0000 UTC m=+116.890274733" watchObservedRunningTime="2026-09-17 18:41:00.659526605 +0000 UTC m=+116.892100630" Sep 17 18:41:01.368952 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:01.368920 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:01.491183 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:01.491152 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:01.607763 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:01.607722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:01.705795 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:01.705741 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:02.615201 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:02.615174 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c8f64dc6b-s7lrw" Sep 17 18:41:03.105195 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:03.105160 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:03.211708 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:03.211673 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:03.702129 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:03.702081 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:03.797713 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:03.797680 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:03.993400 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:03.993318 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:04.094168 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:04.094136 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:04.247912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:04.247828 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:04.935096 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:04.935064 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:41:08.149240 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:08.149206 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:08.270158 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:08.270132 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:08.367126 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:08.367088 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:09.678055 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:09.678025 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:09.780226 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:09.780167 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:11.015541 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:11.015505 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:11.098546 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:11.098516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:12.575083 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:12.575053 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:41:12.575439 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:12.575134 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:41:14.685404 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:14.685369 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:41:14.687663 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:14.687637 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66bf0137-1227-44aa-a252-3dfaea381b1f-metrics-certs\") pod \"network-metrics-daemon-tzrr8\" (UID: \"66bf0137-1227-44aa-a252-3dfaea381b1f\") " pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:41:14.691776 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:14.691739 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nghzc\"" Sep 17 18:41:14.700476 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:14.700454 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrr8" Sep 17 18:41:14.979733 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:14.979702 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tzrr8"] Sep 17 18:41:14.983070 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:41:14.983032 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bf0137_1227_44aa_a252_3dfaea381b1f.slice/crio-bf6c14d331b68d3e6e80dfd2888bc84f83027bf31438a1eb73f7457b9710c456 WatchSource:0}: Error finding container bf6c14d331b68d3e6e80dfd2888bc84f83027bf31438a1eb73f7457b9710c456: Status 404 returned error can't find the container with id bf6c14d331b68d3e6e80dfd2888bc84f83027bf31438a1eb73f7457b9710c456 Sep 17 18:41:15.683582 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:15.683550 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzrr8" event={"ID":"66bf0137-1227-44aa-a252-3dfaea381b1f","Type":"ContainerStarted","Data":"bf6c14d331b68d3e6e80dfd2888bc84f83027bf31438a1eb73f7457b9710c456"} Sep 17 18:41:16.688988 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:16.688949 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzrr8" event={"ID":"66bf0137-1227-44aa-a252-3dfaea381b1f","Type":"ContainerStarted","Data":"71ecbbf91ad2a36087fa9dca9c5aa23871ce1240db01cfe7f35496e2c3fbd122"} Sep 17 18:41:16.689364 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:16.689051 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzrr8" event={"ID":"66bf0137-1227-44aa-a252-3dfaea381b1f","Type":"ContainerStarted","Data":"ac627b564913ac01f8dfb75f506dd8602eb567a333e80ff678dadbb3f2374557"} Sep 17 18:41:16.707452 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:16.707397 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tzrr8" podStartSLOduration=129.651313475 podStartE2EDuration="2m10.707382794s" totalImagesPullingTime="1.056069319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:41:16.70627811 +0000 UTC m=+132.938852135" watchObservedRunningTime="2026-09-17 18:41:16.707382794 +0000 UTC m=+132.939956866" Sep 17 18:41:16.844942 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:16.844913 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:16.952046 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:16.951979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:17.991798 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:17.991765 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:18.092640 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:18.092612 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:23.166987 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:23.166953 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:23.349289 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:23.349258 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:32.580269 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:32.580240 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:41:32.583974 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:32.583949 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-794546dc68-788bd" Sep 17 18:41:38.457215 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:38.457184 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:38.545183 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:38.545144 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:39.669586 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:39.669556 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:39.728368 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:39.728346 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:43.545123 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:43.545092 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:43.644559 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:43.644525 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:46.085631 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:46.085601 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:50.367842 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:50.367739 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:41:54.936041 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:54.935218 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:41:54.951342 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:54.951317 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:41:55.865812 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:41:55.865779 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:07.598413 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:07.598381 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:07.700466 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:07.700432 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:13.048443 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.048410 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:42:13.049384 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.049328 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="prometheus" containerID="cri-o://e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a" gracePeriod=600 Sep 17 18:42:13.049665 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.049419 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy" containerID="cri-o://7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037" gracePeriod=600 Sep 17 18:42:13.049802 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.049439 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-web" containerID="cri-o://3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b" gracePeriod=600 Sep 17 18:42:13.049802 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.049770 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b" gracePeriod=600 Sep 17 18:42:13.049931 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.049470 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="thanos-sidecar" containerID="cri-o://e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3" gracePeriod=600 Sep 17 18:42:13.049931 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.049487 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="config-reloader" containerID="cri-o://89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c" gracePeriod=600 Sep 17 18:42:13.920355 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920323 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b" exitCode=0 Sep 17 18:42:13.920355 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920349 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037" exitCode=0 Sep 17 18:42:13.920355 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920356 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3" exitCode=0 Sep 17 18:42:13.920355 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920362 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c" exitCode=0 Sep 17 18:42:13.920613 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920367 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a" exitCode=0 Sep 17 18:42:13.920613 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920393 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b"} Sep 17 18:42:13.920613 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920480 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037"} Sep 17 18:42:13.920613 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920506 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3"} Sep 17 18:42:13.920613 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920540 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c"} Sep 17 18:42:13.920613 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:13.920565 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a"} Sep 17 18:42:14.290982 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.290960 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:14.464317 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464240 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-trusted-ca-bundle\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464317 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464279 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj8mw\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-kube-api-access-kj8mw\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464317 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464299 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-serving-certs-ca-bundle\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464606 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464328 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464606 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464549 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-kube-rbac-proxy\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464606 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464582 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-grpc-tls\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464606 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464608 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-2\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464642 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464648 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464668 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464695 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-kubelet-serving-ca-bundle\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464726 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-web-config\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464780 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-0\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464784 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.464846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464808 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-thanos-prometheus-http-client-file\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464867 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config-out\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464897 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-metrics-client-ca\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464923 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-tls\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464947 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-tls-assets\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.464976 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-db\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465000 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-1\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465040 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-metrics-client-certs\") pod \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\" (UID: \"087856b5-ff1b-41f6-a82c-562e44c2f2dd\") " Sep 17 18:42:14.465238 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465156 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.465625 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465343 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.465625 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465371 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.465625 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465386 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.465625 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.465481 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.467089 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.466952 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-kube-api-access-kj8mw" (OuterVolumeSpecName: "kube-api-access-kj8mw") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "kube-api-access-kj8mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:42:14.467089 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.467038 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.467281 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.467090 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.467548 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.467470 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.467646 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.467608 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config-out" (OuterVolumeSpecName: "config-out") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:42:14.467851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.467829 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.468481 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.468446 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config" (OuterVolumeSpecName: "config") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.468481 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.468458 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.468798 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.468769 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.468903 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.468817 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:42:14.469226 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.469074 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:42:14.469226 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.469194 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.469399 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.469320 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:42:14.469771 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.469728 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.470923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.470905 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.479579 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.479559 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-web-config" (OuterVolumeSpecName: "web-config") pod "087856b5-ff1b-41f6-a82c-562e44c2f2dd" (UID: "087856b5-ff1b-41f6-a82c-562e44c2f2dd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:42:14.566004 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.565971 2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-kube-rbac-proxy\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566004 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566004 2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-grpc-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566018 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566029 2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566037 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566046 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-web-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566054 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566062 2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566071 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-config-out\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566078 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-configmap-metrics-client-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566086 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566094 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-tls-assets\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566102 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-db\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566110 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087856b5-ff1b-41f6-a82c-562e44c2f2dd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566119 2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-metrics-client-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566127 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj8mw\" (UniqueName: \"kubernetes.io/projected/087856b5-ff1b-41f6-a82c-562e44c2f2dd-kube-api-access-kj8mw\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.566521 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.566135 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087856b5-ff1b-41f6-a82c-562e44c2f2dd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:42:14.928243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.928160 2552 generic.go:356] "Generic (PLEG): container finished" podID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerID="3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b" exitCode=0 Sep 17 18:42:14.928243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.928202 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b"} Sep 17 18:42:14.928243 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.928234 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:14.928428 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.928258 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087856b5-ff1b-41f6-a82c-562e44c2f2dd","Type":"ContainerDied","Data":"09295ef8d3efbb747cbc73cb9c146a9b13fd203253c030b51b7212c6b34370b5"} Sep 17 18:42:14.928428 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.928301 2552 scope.go:117] "RemoveContainer" containerID="5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b" Sep 17 18:42:14.936057 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.936001 2552 scope.go:117] "RemoveContainer" containerID="7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037" Sep 17 18:42:14.943076 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.943058 2552 scope.go:117] "RemoveContainer" containerID="3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b" Sep 17 18:42:14.949240 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.949223 2552 scope.go:117] "RemoveContainer" containerID="e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3" Sep 17 18:42:14.955075 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.955055 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:42:14.956661 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.956639 2552 scope.go:117] "RemoveContainer" containerID="89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c" Sep 17 18:42:14.962618 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.962593 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:42:14.963307 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.963290 2552 scope.go:117] "RemoveContainer" containerID="e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a" Sep 17 18:42:14.970031 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.970014 2552 scope.go:117] "RemoveContainer" containerID="72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55" Sep 17 18:42:14.976333 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.976318 2552 scope.go:117] "RemoveContainer" containerID="5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b" Sep 17 18:42:14.976574 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.976556 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b\": container with ID starting with 5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b not found: ID does not exist" containerID="5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b" Sep 17 18:42:14.976641 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.976584 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b"} err="failed to get container status \"5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b\": rpc error: code = NotFound desc = could not find container \"5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b\": container with ID starting with 5200d2fe0c0ed0dfe2ff7724184a6e49bf1558ce6caa4cb54bdb624179bf863b not found: ID does not exist" Sep 17 18:42:14.976641 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.976622 2552 scope.go:117] "RemoveContainer" containerID="7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037" Sep 17 18:42:14.976913 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.976896 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037\": container with ID starting with 7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037 not found: ID does not exist" containerID="7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037" Sep 17 18:42:14.976951 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.976919 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037"} err="failed to get container status \"7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037\": rpc error: code = NotFound desc = could not find container \"7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037\": container with ID starting with 7df69526bf31f04ca5a18e44226a80c36dcdf2c8c1b5faa17f4eec550483a037 not found: ID does not exist" Sep 17 18:42:14.976951 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.976934 2552 scope.go:117] "RemoveContainer" containerID="3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b" Sep 17 18:42:14.977148 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.977132 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b\": container with ID starting with 3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b not found: ID does not exist" containerID="3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b" Sep 17 18:42:14.977190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977154 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b"} err="failed to get container status \"3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b\": rpc error: code = NotFound desc = could not find container \"3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b\": container with ID starting with 3b626fc071077aa2d0d4fffa9a502b362a82f7d320b543a3b50b52bf881fa32b not found: ID does not exist" Sep 17 18:42:14.977190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977169 2552 scope.go:117] "RemoveContainer" containerID="e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3" Sep 17 18:42:14.977402 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.977386 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3\": container with ID starting with e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3 not found: ID does not exist" containerID="e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3" Sep 17 18:42:14.977462 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977408 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3"} err="failed to get container status \"e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3\": rpc error: code = NotFound desc = could not find container \"e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3\": container with ID starting with e11e17ec5ab60a339db3045ea393412631e506c8ef23e9e79a0741254f8fdfe3 not found: ID does not exist" Sep 17 18:42:14.977462 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977426 2552 scope.go:117] "RemoveContainer" containerID="89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c" Sep 17 18:42:14.977642 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.977626 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c\": container with ID starting with 89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c not found: ID does not exist" containerID="89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c" Sep 17 18:42:14.977682 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977646 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c"} err="failed to get container status \"89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c\": rpc error: code = NotFound desc = could not find container \"89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c\": container with ID starting with 89398359c09f03c30f7f97c6e8ed72f3c6beb7f47213f410943cd0f982e9980c not found: ID does not exist" Sep 17 18:42:14.977682 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977659 2552 scope.go:117] "RemoveContainer" containerID="e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a" Sep 17 18:42:14.977919 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.977903 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a\": container with ID starting with e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a not found: ID does not exist" containerID="e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a" Sep 17 18:42:14.977958 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977931 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a"} err="failed to get container status \"e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a\": rpc error: code = NotFound desc = could not find container \"e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a\": container with ID starting with e3830f2cec73a5d656d2902161f325a80415cc3727b55e87d9ca34f7aa11dc7a not found: ID does not exist" Sep 17 18:42:14.977958 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.977944 2552 scope.go:117] "RemoveContainer" containerID="72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55" Sep 17 18:42:14.978169 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:42:14.978153 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55\": container with ID starting with 72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55 not found: ID does not exist" containerID="72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55" Sep 17 18:42:14.978218 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:14.978175 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55"} err="failed to get container status \"72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55\": rpc error: code = NotFound desc = could not find container \"72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55\": container with ID starting with 72522b9ecbe29c030324dca36823885e9639000519e7ecc31db321bc0f156e55 not found: ID does not exist" Sep 17 18:42:15.006260 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.006237 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:42:15.006769 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.006729 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-web" Sep 17 18:42:15.006884 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.006870 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-web" Sep 17 18:42:15.006963 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.006954 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="config-reloader" Sep 17 18:42:15.007034 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007026 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="config-reloader" Sep 17 18:42:15.007110 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007102 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-thanos" Sep 17 18:42:15.007178 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007170 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-thanos" Sep 17 18:42:15.007244 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007236 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="prometheus" Sep 17 18:42:15.007303 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007296 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="prometheus" Sep 17 18:42:15.007375 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007367 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy" Sep 17 18:42:15.007439 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007431 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy" Sep 17 18:42:15.007503 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007495 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="thanos-sidecar" Sep 17 18:42:15.007566 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007559 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="thanos-sidecar" Sep 17 18:42:15.007632 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007624 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="init-config-reloader" Sep 17 18:42:15.007694 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007687 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="init-config-reloader" Sep 17 18:42:15.007860 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007849 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-thanos" Sep 17 18:42:15.007948 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.007939 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="prometheus" Sep 17 18:42:15.008016 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.008008 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="config-reloader" Sep 17 18:42:15.008083 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.008075 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy" Sep 17 18:42:15.008149 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.008140 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="kube-rbac-proxy-web" Sep 17 18:42:15.008206 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.008199 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" containerName="thanos-sidecar" Sep 17 18:42:15.013811 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.013789 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.016995 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.016977 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 18:42:15.017271 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.017253 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 18:42:15.019071 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.019051 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 18:42:15.019215 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.019198 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 18:42:15.019304 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.019291 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 18:42:15.019692 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.019679 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 18:42:15.020022 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.020008 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 18:42:15.020334 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.020315 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 18:42:15.020767 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.020616 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4gk6fhgkhj00v\"" Sep 17 18:42:15.020767 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.020671 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 18:42:15.021009 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.020988 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 18:42:15.021072 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.021025 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 18:42:15.021072 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.020988 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 18:42:15.021140 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.021030 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mvhkg\"" Sep 17 18:42:15.021140 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.021124 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 18:42:15.028354 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.028333 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 18:42:15.035481 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.035460 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:42:15.070910 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.070876 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071026 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.070929 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071026 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.070955 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-config-out\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071026 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.070978 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071026 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071017 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9qv\" (UniqueName: \"kubernetes.io/projected/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-kube-api-access-8d9qv\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071209 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071209 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071072 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071209 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071091 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-config\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071209 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071115 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071209 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071135 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-web-config\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071209 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071493 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071222 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071493 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071265 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071493 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071314 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071493 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071493 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071480 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071552 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.071718 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.071630 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.172835 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.172814 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.172923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.172842 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.172923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.172857 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-config\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.172923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.172871 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.172923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.172884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-web-config\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.172923 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.172901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173059 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173139 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173160 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173188 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173246 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173276 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173317 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173357 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173366 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-config-out\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.173518 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.173465 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9qv\" (UniqueName: \"kubernetes.io/projected/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-kube-api-access-8d9qv\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.174297 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.174011 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.174297 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.174022 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176064 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.175999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-config\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176064 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.176041 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176214 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.176082 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176544 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.176436 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-web-config\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176544 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.176505 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.176627 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.176687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.176677 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.177150 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.177127 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.177233 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.177127 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.177553 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.177514 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.178036 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.177999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.178342 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.178290 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.178574 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.178548 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.178809 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.178792 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.179242 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.179226 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-config-out\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.179409 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.179388 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.182664 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.182644 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9qv\" (UniqueName: \"kubernetes.io/projected/efa22522-9cb6-4f94-8a2d-ed2ec4aa5819-kube-api-access-8d9qv\") pod \"prometheus-k8s-0\" (UID: \"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.323217 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.323193 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:15.634206 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.634183 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:42:15.636361 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:42:15.636336 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa22522_9cb6_4f94_8a2d_ed2ec4aa5819.slice/crio-8d9306fa7fb1d8906f005252226a63d4613238b0f549d170a78e672782a29544 WatchSource:0}: Error finding container 8d9306fa7fb1d8906f005252226a63d4613238b0f549d170a78e672782a29544: Status 404 returned error can't find the container with id 8d9306fa7fb1d8906f005252226a63d4613238b0f549d170a78e672782a29544 Sep 17 18:42:15.933909 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.933840 2552 generic.go:356] "Generic (PLEG): container finished" podID="efa22522-9cb6-4f94-8a2d-ed2ec4aa5819" containerID="cf71956e2f219f730df7c84ddd5c7f8d189368683d76ff7a0569dbbef3fbc80e" exitCode=0 Sep 17 18:42:15.933909 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.933876 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerDied","Data":"cf71956e2f219f730df7c84ddd5c7f8d189368683d76ff7a0569dbbef3fbc80e"} Sep 17 18:42:15.934063 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.933924 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"8d9306fa7fb1d8906f005252226a63d4613238b0f549d170a78e672782a29544"} Sep 17 18:42:15.978907 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:15.978880 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087856b5-ff1b-41f6-a82c-562e44c2f2dd" path="/var/lib/kubelet/pods/087856b5-ff1b-41f6-a82c-562e44c2f2dd/volumes" Sep 17 18:42:16.395937 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.395888 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:16.515744 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.515712 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:16.612492 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.612467 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:16.942986 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.942956 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"0d42aded9d92d9c3dc42db80170052cd208453f15b204daac50d83617b409176"} Sep 17 18:42:16.943224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.943046 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"c478b664e716ec18ee72269b51cf5b4bd15fe98ed9132f643864509889cb12b5"} Sep 17 18:42:16.943224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.943081 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"d69a8ee5a1d8f44adf3bec23da7cafd4b24c4096ca218027f8cf8c68b87cf036"} Sep 17 18:42:16.943224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.943106 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"5c22e8e0d21d6ef0615e036537db066f8d94f33f103e3bef08980d33c56595dd"} Sep 17 18:42:16.943224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.943129 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"fa263359547a8cfbc6d90284dc35c2da5238f680e9593f55d05e3c5557ab6a01"} Sep 17 18:42:16.943224 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:16.943150 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efa22522-9cb6-4f94-8a2d-ed2ec4aa5819","Type":"ContainerStarted","Data":"17f324ee0c552e579637ad8d225a92f644d7e8011000c4fa5a0cc1069a67513b"} Sep 17 18:42:17.146389 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:17.146350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:17.327497 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:17.327411 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:20.323588 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:20.323560 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:42:27.335352 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:27.335313 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:27.436191 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:27.436162 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:27.513388 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:27.513361 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:42:37.432232 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:42:37.432199 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:13.686107 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:13.686068 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:13.761485 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:13.761456 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:15.323647 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:15.323615 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:43:15.339309 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:15.339287 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:43:15.371421 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:15.371368 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=61.353276494 podStartE2EDuration="1m1.371349362s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.072868ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:42:16.980611566 +0000 UTC m=+193.213185591" watchObservedRunningTime="2026-09-17 18:43:15.371349362 +0000 UTC m=+251.603923388" Sep 17 18:43:16.172687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:16.172662 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:43:22.876156 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:22.876076 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:22.977058 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:22.977027 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:28.291079 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:28.291046 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:28.352844 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:28.352818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:34.770875 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:34.770843 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:34.871132 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:34.871104 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:39.617217 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:39.617179 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:39.719197 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:39.719171 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:39.819886 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:39.819856 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:54.825854 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:54.825816 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:43:54.894795 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:43:54.894770 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:44:05.896785 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:44:05.896742 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:44:05.901963 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:44:05.901939 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:44:05.904546 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:44:05.904526 2552 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 18:45:54.921075 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:45:54.921044 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:45:56.188421 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:45:56.188392 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:05.816674 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:05.816641 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:06.170708 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:06.170635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:06.282082 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:06.282054 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:06.357062 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:06.357029 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:51.611493 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:51.611450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:51.720848 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:51.720809 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:51.828269 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:51.828232 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:53.442045 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:53.442001 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:53.536977 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:53.536933 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:53.692678 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:53.692540 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:55.253332 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:55.253269 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:46:55.353236 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:46:55.353188 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:20.171085 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:20.171030 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:20.288557 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:20.288490 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:26.051706 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:26.051659 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:26.375286 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:26.375164 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:26.561228 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:26.561185 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:26.665003 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:26.664899 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:26.907350 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:26.907312 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:27.093056 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:27.093008 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:27.246341 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:27.246298 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:27.408891 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:27.408740 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:27.545166 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:27.545119 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:27.727348 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:27.727303 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:47:27.822412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:47:27.822370 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:18.590856 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:18.590814 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:18.651900 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:18.651861 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:54.287122 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:54.287073 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:54.417216 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:54.417165 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:54.507123 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:54.507075 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:54.585348 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:54.585260 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:54.685932 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:54.685891 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:55.251417 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:55.251369 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:48:55.351239 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:48:55.351178 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:49:05.930678 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:49:05.930637 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:49:05.931481 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:49:05.931460 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:49:58.882031 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:49:58.881983 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:12.216628 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:12.216592 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:12.310486 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:12.310457 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:12.458120 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:12.458080 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:12.604285 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:12.604217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:12.711085 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:12.711059 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:13.524307 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:13.524271 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:13.599691 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:13.599665 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:29.275035 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.275001 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-qkpnb"] Sep 17 18:50:29.278197 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.278180 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.280631 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.280608 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 17 18:50:29.280775 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.280607 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-z8znz\"" Sep 17 18:50:29.281025 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.281002 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 18:50:29.281273 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.281256 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 18:50:29.281358 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.281302 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 18:50:29.288889 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.288870 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qkpnb"] Sep 17 18:50:29.373289 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.373262 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5hmx\" (UniqueName: \"kubernetes.io/projected/ff3dfdb3-4622-4427-8da3-3221907d5e02-kube-api-access-h5hmx\") pod \"s3-init-qkpnb\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.373427 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.373311 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3dfdb3-4622-4427-8da3-3221907d5e02-model-cache\") pod \"s3-init-qkpnb\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.474626 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.474599 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5hmx\" (UniqueName: \"kubernetes.io/projected/ff3dfdb3-4622-4427-8da3-3221907d5e02-kube-api-access-h5hmx\") pod \"s3-init-qkpnb\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.474800 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.474649 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3dfdb3-4622-4427-8da3-3221907d5e02-model-cache\") pod \"s3-init-qkpnb\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.475047 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.475030 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3dfdb3-4622-4427-8da3-3221907d5e02-model-cache\") pod \"s3-init-qkpnb\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.485921 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.485900 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5hmx\" (UniqueName: \"kubernetes.io/projected/ff3dfdb3-4622-4427-8da3-3221907d5e02-kube-api-access-h5hmx\") pod \"s3-init-qkpnb\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.556582 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.556497 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:50:29.593369 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.593348 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qkpnb" Sep 17 18:50:29.865573 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.865550 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qkpnb"] Sep 17 18:50:29.867522 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:50:29.867495 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3dfdb3_4622_4427_8da3_3221907d5e02.slice/crio-8b6597f533a76954d7eb91a43c7323ebccb07f17b24021a7410e47042a08b217 WatchSource:0}: Error finding container 8b6597f533a76954d7eb91a43c7323ebccb07f17b24021a7410e47042a08b217: Status 404 returned error can't find the container with id 8b6597f533a76954d7eb91a43c7323ebccb07f17b24021a7410e47042a08b217 Sep 17 18:50:29.869455 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.869438 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:50:29.942605 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:29.942579 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qkpnb" event={"ID":"ff3dfdb3-4622-4427-8da3-3221907d5e02","Type":"ContainerStarted","Data":"8b6597f533a76954d7eb91a43c7323ebccb07f17b24021a7410e47042a08b217"} Sep 17 18:50:33.963363 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:33.963329 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qkpnb" event={"ID":"ff3dfdb3-4622-4427-8da3-3221907d5e02","Type":"ContainerStarted","Data":"ee969312e633cedeff7c6819c390d0a94774a3fb388670aeedee17b7ff4db5ba"} Sep 17 18:50:36.977450 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:36.977419 2552 generic.go:356] "Generic (PLEG): container finished" podID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerID="ee969312e633cedeff7c6819c390d0a94774a3fb388670aeedee17b7ff4db5ba" exitCode=0 Sep 17 18:50:36.977851 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:36.977463 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qkpnb" event={"ID":"ff3dfdb3-4622-4427-8da3-3221907d5e02","Type":"ContainerDied","Data":"ee969312e633cedeff7c6819c390d0a94774a3fb388670aeedee17b7ff4db5ba"} Sep 17 18:50:42.001018 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:42.000987 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qkpnb" event={"ID":"ff3dfdb3-4622-4427-8da3-3221907d5e02","Type":"ContainerStarted","Data":"db215bef7a83cf3bab8d6c8c20a58ac3102b2bd4386a25090c95376aa95c49b8"} Sep 17 18:50:42.022259 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:42.022210 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-qkpnb" podStartSLOduration=1.900236369 podStartE2EDuration="13.022195323s" totalImagesPullingTime="8.311848765s" totalInitContainerRuntime="2.810110189s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:50:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:50:42.020818879 +0000 UTC m=+698.253392905" watchObservedRunningTime="2026-09-17 18:50:42.022195323 +0000 UTC m=+698.254769349" Sep 17 18:50:52.398302 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:50:52.398227 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:51:47.258211 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:47.258175 2552 generic.go:356] "Generic (PLEG): container finished" podID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerID="db215bef7a83cf3bab8d6c8c20a58ac3102b2bd4386a25090c95376aa95c49b8" exitCode=0 Sep 17 18:51:47.258661 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:47.258236 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qkpnb" event={"ID":"ff3dfdb3-4622-4427-8da3-3221907d5e02","Type":"ContainerDied","Data":"db215bef7a83cf3bab8d6c8c20a58ac3102b2bd4386a25090c95376aa95c49b8"} Sep 17 18:51:48.387412 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.387389 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qkpnb" Sep 17 18:51:48.508482 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.508454 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3dfdb3-4622-4427-8da3-3221907d5e02-model-cache\") pod \"ff3dfdb3-4622-4427-8da3-3221907d5e02\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " Sep 17 18:51:48.508637 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.508512 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5hmx\" (UniqueName: \"kubernetes.io/projected/ff3dfdb3-4622-4427-8da3-3221907d5e02-kube-api-access-h5hmx\") pod \"ff3dfdb3-4622-4427-8da3-3221907d5e02\" (UID: \"ff3dfdb3-4622-4427-8da3-3221907d5e02\") " Sep 17 18:51:48.510557 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.510529 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3dfdb3-4622-4427-8da3-3221907d5e02-kube-api-access-h5hmx" (OuterVolumeSpecName: "kube-api-access-h5hmx") pod "ff3dfdb3-4622-4427-8da3-3221907d5e02" (UID: "ff3dfdb3-4622-4427-8da3-3221907d5e02"). InnerVolumeSpecName "kube-api-access-h5hmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:51:48.526939 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.526912 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3dfdb3-4622-4427-8da3-3221907d5e02-model-cache" (OuterVolumeSpecName: "model-cache") pod "ff3dfdb3-4622-4427-8da3-3221907d5e02" (UID: "ff3dfdb3-4622-4427-8da3-3221907d5e02"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:51:48.609254 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.609226 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5hmx\" (UniqueName: \"kubernetes.io/projected/ff3dfdb3-4622-4427-8da3-3221907d5e02-kube-api-access-h5hmx\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:51:48.609254 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:48.609251 2552 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3dfdb3-4622-4427-8da3-3221907d5e02-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:51:49.266665 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:49.266627 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qkpnb" event={"ID":"ff3dfdb3-4622-4427-8da3-3221907d5e02","Type":"ContainerDied","Data":"8b6597f533a76954d7eb91a43c7323ebccb07f17b24021a7410e47042a08b217"} Sep 17 18:51:49.266665 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:49.266669 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b6597f533a76954d7eb91a43c7323ebccb07f17b24021a7410e47042a08b217" Sep 17 18:51:49.266877 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:49.266670 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qkpnb" Sep 17 18:51:49.635317 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:49.635243 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:51:51.079806 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:51.079775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:51:57.385013 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:57.384979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:51:57.448124 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:51:57.448090 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.047328 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.047299 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.160671 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.160635 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl"] Sep 17 18:52:01.160969 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.160956 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerName="s3-init" Sep 17 18:52:01.161020 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.160970 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerName="s3-init" Sep 17 18:52:01.161020 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.160987 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerName="download-hf-model" Sep 17 18:52:01.161020 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.160992 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerName="download-hf-model" Sep 17 18:52:01.161111 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.161060 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3dfdb3-4622-4427-8da3-3221907d5e02" containerName="s3-init" Sep 17 18:52:01.163944 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.163921 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.166213 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166186 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 17 18:52:01.166213 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166206 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 17 18:52:01.166534 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166231 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 17 18:52:01.166534 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166419 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 17 18:52:01.166673 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166547 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 17 18:52:01.166673 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166569 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 18:52:01.166912 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.166884 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-b8646\"" Sep 17 18:52:01.177228 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.177206 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl"] Sep 17 18:52:01.207627 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.207593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt8gg\" (UniqueName: \"kubernetes.io/projected/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-api-access-nt8gg\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.207734 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.207651 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.207734 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.207711 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.207861 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.207800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eef44423-411a-4d25-bc2b-4f74a0807b5c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.207861 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.207846 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.252068 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.252037 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.309062 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.309157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt8gg\" (UniqueName: \"kubernetes.io/projected/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-api-access-nt8gg\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.309216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.309263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.309327 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eef44423-411a-4d25-bc2b-4f74a0807b5c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.309763 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eef44423-411a-4d25-bc2b-4f74a0807b5c-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:52:01.309879 2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:52:01.309937 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls podName:eef44423-411a-4d25-bc2b-4f74a0807b5c nodeName:}" failed. No retries permitted until 2026-09-17 18:52:01.80991671 +0000 UTC m=+778.042490716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls") pod "isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" (UID: "eef44423-411a-4d25-bc2b-4f74a0807b5c") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.310208 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.310803 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.310705 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.318977 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.318920 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt8gg\" (UniqueName: \"kubernetes.io/projected/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-api-access-nt8gg\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.360504 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.360479 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.459632 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.459603 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.543418 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.543386 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.622801 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.622713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.664187 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.664156 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l"] Sep 17 18:52:01.667965 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.667946 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.670078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.670055 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 17 18:52:01.670182 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.670112 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 17 18:52:01.678649 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.678625 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l"] Sep 17 18:52:01.703180 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.703160 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.712283 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.712264 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.712353 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.712303 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkc76\" (UniqueName: \"kubernetes.io/projected/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-api-access-lkc76\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.712353 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.712341 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.712419 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.712390 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.712419 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.712411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/185888ba-2482-4283-8fdb-a65ad4133a3b-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.812810 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.812785 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkc76\" (UniqueName: \"kubernetes.io/projected/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-api-access-lkc76\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.812914 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.812845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.812914 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.812891 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.813021 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.812921 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/185888ba-2482-4283-8fdb-a65ad4133a3b-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.813021 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.812958 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.813123 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.813017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.813227 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:52:01.813209 2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Sep 17 18:52:01.813295 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:52:01.813274 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls podName:185888ba-2482-4283-8fdb-a65ad4133a3b nodeName:}" failed. No retries permitted until 2026-09-17 18:52:02.313256353 +0000 UTC m=+778.545830361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls") pod "isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" (UID: "185888ba-2482-4283-8fdb-a65ad4133a3b") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Sep 17 18:52:01.813565 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.813537 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.813687 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.813663 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/185888ba-2482-4283-8fdb-a65ad4133a3b-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.813802 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.813735 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.815585 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.815565 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:01.824212 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.824181 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkc76\" (UniqueName: \"kubernetes.io/projected/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-api-access-lkc76\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:01.903292 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.903234 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:01.980237 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:01.980211 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:52:02.075993 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:02.075967 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:02.317181 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:02.317146 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:02.319387 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:02.319361 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:02.352341 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:02.352313 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl"] Sep 17 18:52:02.355422 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:52:02.355398 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef44423_411a_4d25_bc2b_4f74a0807b5c.slice/crio-3db31d86b0d6170863a7a9a95d0f66768e2f9b2593f5fb049db29f0e0e0094c0 WatchSource:0}: Error finding container 3db31d86b0d6170863a7a9a95d0f66768e2f9b2593f5fb049db29f0e0e0094c0: Status 404 returned error can't find the container with id 3db31d86b0d6170863a7a9a95d0f66768e2f9b2593f5fb049db29f0e0e0094c0 Sep 17 18:52:02.581319 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:02.581240 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:02.865308 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:02.865282 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l"] Sep 17 18:52:02.867353 ip-10-0-136-140 kubenswrapper[2552]: W0917 18:52:02.867324 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185888ba_2482_4283_8fdb_a65ad4133a3b.slice/crio-3af15b96b51ceb8006aed8676c21cdf1f800f6b5dd86ce0afa026fc625413809 WatchSource:0}: Error finding container 3af15b96b51ceb8006aed8676c21cdf1f800f6b5dd86ce0afa026fc625413809: Status 404 returned error can't find the container with id 3af15b96b51ceb8006aed8676c21cdf1f800f6b5dd86ce0afa026fc625413809 Sep 17 18:52:03.322217 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:03.322177 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerStarted","Data":"cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425"} Sep 17 18:52:03.322673 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:03.322249 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerStarted","Data":"3db31d86b0d6170863a7a9a95d0f66768e2f9b2593f5fb049db29f0e0e0094c0"} Sep 17 18:52:03.323899 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:03.323875 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerStarted","Data":"e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5"} Sep 17 18:52:03.323988 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:03.323921 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerStarted","Data":"3af15b96b51ceb8006aed8676c21cdf1f800f6b5dd86ce0afa026fc625413809"} Sep 17 18:52:07.340078 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:07.340047 2552 generic.go:356] "Generic (PLEG): container finished" podID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerID="cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425" exitCode=0 Sep 17 18:52:07.340480 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:07.340121 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerDied","Data":"cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425"} Sep 17 18:52:07.341828 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:07.341713 2552 generic.go:356] "Generic (PLEG): container finished" podID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerID="e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5" exitCode=0 Sep 17 18:52:07.341828 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:07.341770 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerDied","Data":"e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5"} Sep 17 18:52:23.447763 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:23.447720 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerStarted","Data":"ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4"} Sep 17 18:52:23.449547 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:23.449521 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerStarted","Data":"dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228"} Sep 17 18:52:26.468360 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.468324 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerStarted","Data":"93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb"} Sep 17 18:52:26.468860 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.468405 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:26.468860 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.468587 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:26.470100 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.470068 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:52:26.470658 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.470639 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerStarted","Data":"f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d"} Sep 17 18:52:26.470848 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.470829 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:26.470921 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.470873 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:26.471742 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.471712 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:52:26.490805 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.490743 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podStartSLOduration=2.734572591 podStartE2EDuration="25.490731243s" totalImagesPullingTime="18.728243676s" totalInitContainerRuntime="4.027914976s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:52:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:52:26.490520523 +0000 UTC m=+802.723094549" watchObservedRunningTime="2026-09-17 18:52:26.490731243 +0000 UTC m=+802.723305350" Sep 17 18:52:26.511731 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:26.511694 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podStartSLOduration=3.1724720140000002 podStartE2EDuration="25.511685342s" totalImagesPullingTime="18.70296068s" totalInitContainerRuntime="3.636252648s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:52:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:52:26.51045189 +0000 UTC m=+802.743025912" watchObservedRunningTime="2026-09-17 18:52:26.511685342 +0000 UTC m=+802.744259367" Sep 17 18:52:27.477924 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:27.477825 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:52:27.478368 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:27.477948 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:52:32.482574 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:32.482543 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:52:32.483077 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:32.483042 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:52:32.483146 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:32.483070 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:52:32.483617 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:32.483592 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:52:42.483603 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:42.483565 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:52:42.483996 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:42.483562 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:52:52.483780 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:52.483724 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:52:52.484194 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:52:52.483734 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:53:02.483949 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:02.483912 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:53:02.483949 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:02.483924 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:53:12.483779 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:12.483720 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:53:12.484138 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:12.483727 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:53:21.077509 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:21.077424 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:21.199659 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:21.199628 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:22.483110 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:22.483075 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:53:22.483549 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:22.483528 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:53:32.483647 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:32.483611 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:53:32.484044 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:32.483611 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:53:35.325459 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:35.325418 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:35.469680 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:35.469644 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:35.568527 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:35.568494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:35.670374 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:35.670296 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:35.733956 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:35.733930 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:35.831233 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:35.831204 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:53:42.483941 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:42.483910 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:53:42.484367 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:53:42.484029 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:54:05.964148 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:05.964112 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:54:05.964698 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:05.964679 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:54:11.038813 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:11.038775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:11.479775 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:11.479716 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:14.190909 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:14.190878 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:21.637673 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.637635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:21.739049 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.739005 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l"] Sep 17 18:54:21.739419 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.739355 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" containerID="cri-o://ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4" gracePeriod=30 Sep 17 18:54:21.739595 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.739419 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kube-rbac-proxy" containerID="cri-o://f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d" gracePeriod=30 Sep 17 18:54:21.787662 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.787621 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl"] Sep 17 18:54:21.788003 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.787952 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" containerID="cri-o://dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228" gracePeriod=30 Sep 17 18:54:21.788097 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.787978 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kube-rbac-proxy" containerID="cri-o://93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb" gracePeriod=30 Sep 17 18:54:21.800560 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.800531 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:21.899500 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.899462 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:21.966536 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.966494 2552 generic.go:356] "Generic (PLEG): container finished" podID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerID="93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb" exitCode=2 Sep 17 18:54:21.966951 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.966921 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerDied","Data":"93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb"} Sep 17 18:54:21.975860 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.975805 2552 generic.go:356] "Generic (PLEG): container finished" podID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerID="f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d" exitCode=2 Sep 17 18:54:21.980641 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.980600 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerDied","Data":"f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d"} Sep 17 18:54:21.995958 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:21.995910 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:22.094381 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.094341 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:22.267392 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.267354 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:22.367364 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.367327 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:22.478255 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.478214 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Sep 17 18:54:22.478446 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.478217 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" Sep 17 18:54:22.483395 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.483360 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 18:54:22.483535 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:22.483464 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 18:54:27.478349 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:27.478306 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" Sep 17 18:54:27.478878 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:27.478302 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Sep 17 18:54:28.408566 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.408497 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:54:28.426760 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.426712 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:54:28.482629 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482588 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-cabundle-cert\") pod \"185888ba-2482-4283-8fdb-a65ad4133a3b\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482647 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/185888ba-2482-4283-8fdb-a65ad4133a3b-kserve-provision-location\") pod \"185888ba-2482-4283-8fdb-a65ad4133a3b\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482686 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls\") pod \"185888ba-2482-4283-8fdb-a65ad4133a3b\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482708 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkc76\" (UniqueName: \"kubernetes.io/projected/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-api-access-lkc76\") pod \"185888ba-2482-4283-8fdb-a65ad4133a3b\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482789 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-rbac-proxy-sar-config\") pod \"eef44423-411a-4d25-bc2b-4f74a0807b5c\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482808 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-cabundle-cert\") pod \"eef44423-411a-4d25-bc2b-4f74a0807b5c\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482827 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eef44423-411a-4d25-bc2b-4f74a0807b5c-kserve-provision-location\") pod \"eef44423-411a-4d25-bc2b-4f74a0807b5c\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482846 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt8gg\" (UniqueName: \"kubernetes.io/projected/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-api-access-nt8gg\") pod \"eef44423-411a-4d25-bc2b-4f74a0807b5c\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482872 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls\") pod \"eef44423-411a-4d25-bc2b-4f74a0807b5c\" (UID: \"eef44423-411a-4d25-bc2b-4f74a0807b5c\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.482890 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-rbac-proxy-sar-config\") pod \"185888ba-2482-4283-8fdb-a65ad4133a3b\" (UID: \"185888ba-2482-4283-8fdb-a65ad4133a3b\") " Sep 17 18:54:28.483190 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.483101 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185888ba-2482-4283-8fdb-a65ad4133a3b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "185888ba-2482-4283-8fdb-a65ad4133a3b" (UID: "185888ba-2482-4283-8fdb-a65ad4133a3b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:54:28.483692 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.483192 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "185888ba-2482-4283-8fdb-a65ad4133a3b" (UID: "185888ba-2482-4283-8fdb-a65ad4133a3b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:54:28.483692 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.483213 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "eef44423-411a-4d25-bc2b-4f74a0807b5c" (UID: "eef44423-411a-4d25-bc2b-4f74a0807b5c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:54:28.483692 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.483430 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef44423-411a-4d25-bc2b-4f74a0807b5c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "eef44423-411a-4d25-bc2b-4f74a0807b5c" (UID: "eef44423-411a-4d25-bc2b-4f74a0807b5c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:54:28.483692 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.483452 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "185888ba-2482-4283-8fdb-a65ad4133a3b" (UID: "185888ba-2482-4283-8fdb-a65ad4133a3b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:54:28.483692 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.483498 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "eef44423-411a-4d25-bc2b-4f74a0807b5c" (UID: "eef44423-411a-4d25-bc2b-4f74a0807b5c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:54:28.485574 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.485543 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "185888ba-2482-4283-8fdb-a65ad4133a3b" (UID: "185888ba-2482-4283-8fdb-a65ad4133a3b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:54:28.485717 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.485588 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "eef44423-411a-4d25-bc2b-4f74a0807b5c" (UID: "eef44423-411a-4d25-bc2b-4f74a0807b5c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:54:28.485717 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.485689 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-api-access-nt8gg" (OuterVolumeSpecName: "kube-api-access-nt8gg") pod "eef44423-411a-4d25-bc2b-4f74a0807b5c" (UID: "eef44423-411a-4d25-bc2b-4f74a0807b5c"). InnerVolumeSpecName "kube-api-access-nt8gg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:54:28.485846 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.485714 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-api-access-lkc76" (OuterVolumeSpecName: "kube-api-access-lkc76") pod "185888ba-2482-4283-8fdb-a65ad4133a3b" (UID: "185888ba-2482-4283-8fdb-a65ad4133a3b"). InnerVolumeSpecName "kube-api-access-lkc76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:54:28.583827 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583779 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkc76\" (UniqueName: \"kubernetes.io/projected/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-api-access-lkc76\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.583827 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583816 2552 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.583827 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583832 2552 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eef44423-411a-4d25-bc2b-4f74a0807b5c-cabundle-cert\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583845 2552 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eef44423-411a-4d25-bc2b-4f74a0807b5c-kserve-provision-location\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583857 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt8gg\" (UniqueName: \"kubernetes.io/projected/eef44423-411a-4d25-bc2b-4f74a0807b5c-kube-api-access-nt8gg\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583871 2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eef44423-411a-4d25-bc2b-4f74a0807b5c-proxy-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583883 2552 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583893 2552 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/185888ba-2482-4283-8fdb-a65ad4133a3b-cabundle-cert\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583904 2552 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/185888ba-2482-4283-8fdb-a65ad4133a3b-kserve-provision-location\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:28.584115 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:28.583916 2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/185888ba-2482-4283-8fdb-a65ad4133a3b-proxy-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 18:54:29.008196 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.008152 2552 generic.go:356] "Generic (PLEG): container finished" podID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerID="ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4" exitCode=0 Sep 17 18:54:29.008454 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.008225 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" Sep 17 18:54:29.008454 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.008242 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerDied","Data":"ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4"} Sep 17 18:54:29.008454 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.008311 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l" event={"ID":"185888ba-2482-4283-8fdb-a65ad4133a3b","Type":"ContainerDied","Data":"3af15b96b51ceb8006aed8676c21cdf1f800f6b5dd86ce0afa026fc625413809"} Sep 17 18:54:29.008454 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.008340 2552 scope.go:117] "RemoveContainer" containerID="f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d" Sep 17 18:54:29.010583 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.010547 2552 generic.go:356] "Generic (PLEG): container finished" podID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerID="dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228" exitCode=0 Sep 17 18:54:29.010727 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.010604 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" Sep 17 18:54:29.010727 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.010624 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerDied","Data":"dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228"} Sep 17 18:54:29.010727 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.010687 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl" event={"ID":"eef44423-411a-4d25-bc2b-4f74a0807b5c","Type":"ContainerDied","Data":"3db31d86b0d6170863a7a9a95d0f66768e2f9b2593f5fb049db29f0e0e0094c0"} Sep 17 18:54:29.017868 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.017842 2552 scope.go:117] "RemoveContainer" containerID="ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4" Sep 17 18:54:29.026821 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.026799 2552 scope.go:117] "RemoveContainer" containerID="e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5" Sep 17 18:54:29.037398 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.037363 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l"] Sep 17 18:54:29.038048 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.038025 2552 scope.go:117] "RemoveContainer" containerID="f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d" Sep 17 18:54:29.038372 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:54:29.038352 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d\": container with ID starting with f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d not found: ID does not exist" containerID="f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d" Sep 17 18:54:29.038415 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.038382 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d"} err="failed to get container status \"f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d\": rpc error: code = NotFound desc = could not find container \"f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d\": container with ID starting with f6818ea0d44b8ccb9d9baa0cee0e138b5bc5a12c32e84af6b9695a327ab0358d not found: ID does not exist" Sep 17 18:54:29.038415 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.038401 2552 scope.go:117] "RemoveContainer" containerID="ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4" Sep 17 18:54:29.038686 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:54:29.038669 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4\": container with ID starting with ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4 not found: ID does not exist" containerID="ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4" Sep 17 18:54:29.038742 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.038688 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4"} err="failed to get container status \"ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4\": rpc error: code = NotFound desc = could not find container \"ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4\": container with ID starting with ef08e86f4c53ada309f8d4900616b54fa735ad18dffc5810c8771cf836e876c4 not found: ID does not exist" Sep 17 18:54:29.038742 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.038703 2552 scope.go:117] "RemoveContainer" containerID="e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5" Sep 17 18:54:29.039018 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:54:29.038997 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5\": container with ID starting with e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5 not found: ID does not exist" containerID="e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5" Sep 17 18:54:29.039075 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.039025 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5"} err="failed to get container status \"e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5\": rpc error: code = NotFound desc = could not find container \"e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5\": container with ID starting with e5fbbdab915467af6e124532b8bb37e233051a98ca6c7751b7cb974125073fc5 not found: ID does not exist" Sep 17 18:54:29.039075 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.039042 2552 scope.go:117] "RemoveContainer" containerID="93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb" Sep 17 18:54:29.042335 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.042312 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l"] Sep 17 18:54:29.048010 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.047990 2552 scope.go:117] "RemoveContainer" containerID="dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228" Sep 17 18:54:29.056235 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.056204 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl"] Sep 17 18:54:29.057711 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.057690 2552 scope.go:117] "RemoveContainer" containerID="cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425" Sep 17 18:54:29.059318 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.059299 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl"] Sep 17 18:54:29.066168 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.066148 2552 scope.go:117] "RemoveContainer" containerID="93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb" Sep 17 18:54:29.066506 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:54:29.066487 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb\": container with ID starting with 93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb not found: ID does not exist" containerID="93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb" Sep 17 18:54:29.066550 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.066518 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb"} err="failed to get container status \"93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb\": rpc error: code = NotFound desc = could not find container \"93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb\": container with ID starting with 93c7991bd9ddb638c2c0cff9cba3ba26a5947cf4083ca86cec90a338a16e88cb not found: ID does not exist" Sep 17 18:54:29.066550 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.066539 2552 scope.go:117] "RemoveContainer" containerID="dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228" Sep 17 18:54:29.066846 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:54:29.066824 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228\": container with ID starting with dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228 not found: ID does not exist" containerID="dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228" Sep 17 18:54:29.066901 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.066855 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228"} err="failed to get container status \"dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228\": rpc error: code = NotFound desc = could not find container \"dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228\": container with ID starting with dd3753439f2da0677222c362019bba983bd2b5bdf5d58bec69310c84aff77228 not found: ID does not exist" Sep 17 18:54:29.066901 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.066876 2552 scope.go:117] "RemoveContainer" containerID="cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425" Sep 17 18:54:29.067141 ip-10-0-136-140 kubenswrapper[2552]: E0917 18:54:29.067124 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425\": container with ID starting with cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425 not found: ID does not exist" containerID="cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425" Sep 17 18:54:29.067189 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.067149 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425"} err="failed to get container status \"cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425\": rpc error: code = NotFound desc = could not find container \"cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425\": container with ID starting with cea2528d0ff56072077ce1ec52b7f46b635ee983ce6fe3e9c83b0637e2fea425 not found: ID does not exist" Sep 17 18:54:29.978491 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.978443 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" path="/var/lib/kubelet/pods/185888ba-2482-4283-8fdb-a65ad4133a3b/volumes" Sep 17 18:54:29.979194 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:29.979171 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" path="/var/lib/kubelet/pods/eef44423-411a-4d25-bc2b-4f74a0807b5c/volumes" Sep 17 18:54:35.545474 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:35.545428 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:54:35.785527 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:54:35.785493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:55:21.905470 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:55:21.905358 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:55:22.306658 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:55:22.306618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:59:00.319343 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:00.319296 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:59:05.998578 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:05.998547 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:59:06.000219 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:06.000196 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 18:59:13.709768 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:13.709711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:59:20.337141 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:20.337102 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:59:20.442933 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:20.442898 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:59:51.820028 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:51.819936 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 18:59:51.920381 ip-10-0-136-140 kubenswrapper[2552]: I0917 18:59:51.920334 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:01:28.768821 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:01:28.768700 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:02:50.217557 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:02:50.217483 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:02:50.379661 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:02:50.379608 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:02:50.490614 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:02:50.490522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:02:50.616727 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:02:50.616689 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:02:50.718222 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:02:50.718194 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:36.351097 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:36.351061 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:36.516057 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:36.516012 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:36.630036 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:36.629955 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:36.741512 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:36.741475 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:36.856850 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:36.856818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:36.964897 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:36.964873 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:50.529587 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:50.529530 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:03:51.052658 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:03:51.052609 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:02.425205 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:02.425177 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:04.185201 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:04.185166 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:06.024050 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:06.024025 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:04:06.026872 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:06.026851 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:04:37.618198 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:37.618108 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:37.696403 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:37.696372 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:46.730482 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:46.730453 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:46.862844 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:46.862797 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:46.959418 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:46.959388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:47.122413 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:47.122331 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:47.269821 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:47.269778 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:04:47.516178 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:04:47.516139 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:05:10.870164 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:05:10.870125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:05:11.009798 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:05:11.009762 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:05:38.153654 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:05:38.153617 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:05:47.004866 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:05:47.004830 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:05:47.322564 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:05:47.322450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:16.259452 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:07:16.259413 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:09:06.050389 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:09:06.050357 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:09:06.053172 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:09:06.053152 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:11:18.903431 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:11:18.903396 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:20.097295 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:11:20.097251 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:25.521406 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:13:25.521325 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:25.618966 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:13:25.618933 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:25.708552 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:13:25.708519 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:25.779072 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:13:25.778987 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:25.872927 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:13:25.872891 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:01.871779 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:01.871731 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.000886 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:02.000852 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.100438 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:02.100412 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.203004 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:02.202976 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.278941 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:02.278912 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.351721 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:02.351695 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.686699 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:02.686619 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:06.080712 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:06.080680 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:14:06.083069 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:06.083041 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:14:25.721677 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:25.721643 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:26.207189 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:26.207162 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:35.810365 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:35.810278 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:35.944201 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:35.944173 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:36.041605 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:36.041568 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:36.114162 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:36.114074 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:36.187529 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:36.187493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:36.362307 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:36.362262 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:36.463853 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:14:36.463820 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:02.093065 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:15:02.092968 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:02.256792 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:15:02.256764 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:36.031439 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:15:36.031400 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:36.343714 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:15:36.343607 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:16:18.614201 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:16:18.614097 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:06.105193 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:19:06.105168 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:19:06.108788 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:19:06.108764 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:20:44.114402 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:20:44.114369 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:50.833813 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:23:50.833677 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:50.943547 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:23:50.943516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:51.023149 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:23:51.023112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:06.130991 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:24:06.130882 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:24:06.136738 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:24:06.136716 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:26:15.891103 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:26:15.891067 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:29:06.157130 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:29:06.157034 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:29:06.163080 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:29:06.163062 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:30:08.093182 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:30:08.093146 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:21.327109 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:21.327013 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:22.750431 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750385 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qcfw4/must-gather-9rnvp"] Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750845 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="storage-initializer" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750862 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="storage-initializer" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750887 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kube-rbac-proxy" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750896 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kube-rbac-proxy" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750913 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="storage-initializer" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750925 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="storage-initializer" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750943 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kube-rbac-proxy" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750953 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kube-rbac-proxy" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750967 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750975 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.750989 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" Sep 17 19:31:22.751019 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.751000 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" Sep 17 19:31:22.751556 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.751110 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kube-rbac-proxy" Sep 17 19:31:22.751556 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.751128 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kserve-container" Sep 17 19:31:22.751556 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.751137 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="185888ba-2482-4283-8fdb-a65ad4133a3b" containerName="kserve-container" Sep 17 19:31:22.751556 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.751151 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef44423-411a-4d25-bc2b-4f74a0807b5c" containerName="kube-rbac-proxy" Sep 17 19:31:22.754743 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.754723 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:22.756985 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.756956 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qcfw4\"/\"openshift-service-ca.crt\"" Sep 17 19:31:22.757109 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.757016 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qcfw4\"/\"default-dockercfg-5t67d\"" Sep 17 19:31:22.757664 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.757642 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qcfw4\"/\"kube-root-ca.crt\"" Sep 17 19:31:22.772246 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.772196 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qcfw4/must-gather-9rnvp"] Sep 17 19:31:22.773718 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.773660 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:22.820155 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.820107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-must-gather-output\") pod \"must-gather-9rnvp\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:22.820155 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.820151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2t6\" (UniqueName: \"kubernetes.io/projected/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-kube-api-access-5q2t6\") pod \"must-gather-9rnvp\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:22.874124 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.874084 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:22.920880 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.920830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-must-gather-output\") pod \"must-gather-9rnvp\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:22.920880 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.920880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2t6\" (UniqueName: \"kubernetes.io/projected/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-kube-api-access-5q2t6\") pod \"must-gather-9rnvp\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:22.921272 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.921251 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-must-gather-output\") pod \"must-gather-9rnvp\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:22.929285 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:22.929239 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2t6\" (UniqueName: \"kubernetes.io/projected/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-kube-api-access-5q2t6\") pod \"must-gather-9rnvp\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:23.075497 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:23.075370 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:23.354037 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:23.354000 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qcfw4/must-gather-9rnvp"] Sep 17 19:31:23.357082 ip-10-0-136-140 kubenswrapper[2552]: W0917 19:31:23.357038 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcda76fae_32f8_40ea_8bd0_aef9e3b8c7b2.slice/crio-2cac1aeddf32395c4982429647a1822827d2a0b82c75f34f15a8c5124c9778fa WatchSource:0}: Error finding container 2cac1aeddf32395c4982429647a1822827d2a0b82c75f34f15a8c5124c9778fa: Status 404 returned error can't find the container with id 2cac1aeddf32395c4982429647a1822827d2a0b82c75f34f15a8c5124c9778fa Sep 17 19:31:23.359335 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:23.359310 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 19:31:23.847824 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:23.847776 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" event={"ID":"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2","Type":"ContainerStarted","Data":"2cac1aeddf32395c4982429647a1822827d2a0b82c75f34f15a8c5124c9778fa"} Sep 17 19:31:29.885678 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:29.885631 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" event={"ID":"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2","Type":"ContainerStarted","Data":"03de6faab885329691fc051e5c31b5dec2b67a950233bdae049fb1feac4024bb"} Sep 17 19:31:30.892840 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:30.892789 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" event={"ID":"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2","Type":"ContainerStarted","Data":"4a0f01a5a059f1fc89506396915ff00a8e6ca2a5ecde5431733f8ef06ca61e8e"} Sep 17 19:31:30.911032 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:30.910948 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" podStartSLOduration=2.553844227 podStartE2EDuration="8.910918893s" totalImagesPullingTime="6.357074666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:31:30.909208128 +0000 UTC m=+3147.141782167" watchObservedRunningTime="2026-09-17 19:31:30.910918893 +0000 UTC m=+3147.143492919" Sep 17 19:31:54.019087 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:54.019041 2552 generic.go:356] "Generic (PLEG): container finished" podID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerID="03de6faab885329691fc051e5c31b5dec2b67a950233bdae049fb1feac4024bb" exitCode=0 Sep 17 19:31:54.019819 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:54.019123 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" event={"ID":"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2","Type":"ContainerDied","Data":"03de6faab885329691fc051e5c31b5dec2b67a950233bdae049fb1feac4024bb"} Sep 17 19:31:54.019819 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:54.019634 2552 scope.go:117] "RemoveContainer" containerID="03de6faab885329691fc051e5c31b5dec2b67a950233bdae049fb1feac4024bb" Sep 17 19:31:54.492298 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:54.492251 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qcfw4_must-gather-9rnvp_cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2/gather/0.log" Sep 17 19:31:54.956627 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:54.956577 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:55.140131 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:55.140071 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:55.229255 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:55.229134 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:57.897300 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:57.897256 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4jzqs_18d54f5d-bdbe-4c39-8a52-15b7075ef194/global-pull-secret-syncer/0.log" Sep 17 19:31:58.048047 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:58.048001 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" Sep 17 19:31:58.173901 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:58.173802 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-140.ec2.internal_16feb325486f0987d2add9b4aa5c9287/haproxy/0.log" Sep 17 19:31:59.927973 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:59.927925 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-qcfw4/must-gather-9rnvp"] Sep 17 19:31:59.928500 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:59.928186 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="copy" containerID="cri-o://4a0f01a5a059f1fc89506396915ff00a8e6ca2a5ecde5431733f8ef06ca61e8e" gracePeriod=2 Sep 17 19:31:59.930815 ip-10-0-136-140 kubenswrapper[2552]: E0917 19:31:59.930734 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9rnvp\" is forbidden: User \"system:node:ip-10-0-136-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-qcfw4\": no relationship found between node 'ip-10-0-136-140.ec2.internal' and this object" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:31:59.933983 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:31:59.933090 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-qcfw4/must-gather-9rnvp"] Sep 17 19:32:00.051627 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.051598 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qcfw4_must-gather-9rnvp_cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2/copy/0.log" Sep 17 19:32:00.052094 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.052063 2552 generic.go:356] "Generic (PLEG): container finished" podID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerID="4a0f01a5a059f1fc89506396915ff00a8e6ca2a5ecde5431733f8ef06ca61e8e" exitCode=143 Sep 17 19:32:00.182689 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.182606 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qcfw4_must-gather-9rnvp_cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2/copy/0.log" Sep 17 19:32:00.184194 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.184173 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:32:00.200536 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.200498 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q2t6\" (UniqueName: \"kubernetes.io/projected/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-kube-api-access-5q2t6\") pod \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " Sep 17 19:32:00.200682 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.200597 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-must-gather-output\") pod \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\" (UID: \"cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2\") " Sep 17 19:32:00.202463 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.202428 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" (UID: "cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:32:00.203369 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.203345 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-kube-api-access-5q2t6" (OuterVolumeSpecName: "kube-api-access-5q2t6") pod "cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" (UID: "cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2"). InnerVolumeSpecName "kube-api-access-5q2t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:32:00.301605 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.301553 2552 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-must-gather-output\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 19:32:00.301605 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:00.301595 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q2t6\" (UniqueName: \"kubernetes.io/projected/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2-kube-api-access-5q2t6\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\"" Sep 17 19:32:01.058419 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.058381 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qcfw4_must-gather-9rnvp_cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2/copy/0.log" Sep 17 19:32:01.059009 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.058883 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qcfw4/must-gather-9rnvp" Sep 17 19:32:01.059009 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.058930 2552 scope.go:117] "RemoveContainer" containerID="4a0f01a5a059f1fc89506396915ff00a8e6ca2a5ecde5431733f8ef06ca61e8e" Sep 17 19:32:01.069191 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.069167 2552 scope.go:117] "RemoveContainer" containerID="03de6faab885329691fc051e5c31b5dec2b67a950233bdae049fb1feac4024bb" Sep 17 19:32:01.324860 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.324690 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:01.428428 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.428371 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-74xw6_3e0724d8-5e19-4333-8dd1-e9f4a9f27ae9/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:01.979973 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:01.979931 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" path="/var/lib/kubelet/pods/cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2/volumes" Sep 17 19:32:02.417370 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.417329 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-lwtwc_8514c6da-d925-424d-a11d-7874566241b1/cluster-monitoring-operator/0.log" Sep 17 19:32:02.449646 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.449616 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wt25k_c986853c-8e2c-4072-be38-8cc9dc21c506/kube-state-metrics/0.log" Sep 17 19:32:02.473446 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.473409 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wt25k_c986853c-8e2c-4072-be38-8cc9dc21c506/kube-rbac-proxy-main/0.log" Sep 17 19:32:02.508923 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.508879 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wt25k_c986853c-8e2c-4072-be38-8cc9dc21c506/kube-rbac-proxy-self/0.log" Sep 17 19:32:02.548905 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.548793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-794546dc68-788bd_ac1e939a-bb7e-448c-ae12-56dd264e6f6b/metrics-server/0.log" Sep 17 19:32:02.589654 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.589609 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-h5kqw_b1871c97-a38e-48b4-8ece-78f384bff4d5/monitoring-plugin/0.log" Sep 17 19:32:02.720340 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.720294 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8wxc_7992ff85-f419-45ca-aadd-db63bd2ae03f/node-exporter/0.log" Sep 17 19:32:02.747975 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.747940 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8wxc_7992ff85-f419-45ca-aadd-db63bd2ae03f/kube-rbac-proxy/0.log" Sep 17 19:32:02.775716 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.775683 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j8wxc_7992ff85-f419-45ca-aadd-db63bd2ae03f/init-textfile/0.log" Sep 17 19:32:02.998459 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:02.998422 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/prometheus/0.log" Sep 17 19:32:03.020161 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.020124 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/config-reloader/0.log" Sep 17 19:32:03.047264 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.047229 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/thanos-sidecar/0.log" Sep 17 19:32:03.074590 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.074559 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/kube-rbac-proxy-web/0.log" Sep 17 19:32:03.103606 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.103579 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/kube-rbac-proxy/0.log" Sep 17 19:32:03.130739 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.130703 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/kube-rbac-proxy-thanos/0.log" Sep 17 19:32:03.166124 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.166096 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efa22522-9cb6-4f94-8a2d-ed2ec4aa5819/init-config-reloader/0.log" Sep 17 19:32:03.203029 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.202988 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-8srln_9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5/prometheus-operator/0.log" Sep 17 19:32:03.225992 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.225964 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-8srln_9b8d5389-32a9-4d8f-ab4b-ebae4e7c1fc5/kube-rbac-proxy/0.log" Sep 17 19:32:03.258007 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.257910 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-pwq8l_5007c75d-900a-44b4-b55c-4fbd939c4265/prometheus-operator-admission-webhook/0.log" Sep 17 19:32:03.400714 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.400677 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8f64dc6b-s7lrw_cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b/thanos-query/0.log" Sep 17 19:32:03.426669 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.426631 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8f64dc6b-s7lrw_cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b/kube-rbac-proxy-web/0.log" Sep 17 19:32:03.456464 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.456433 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8f64dc6b-s7lrw_cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b/kube-rbac-proxy/0.log" Sep 17 19:32:03.482352 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.482322 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8f64dc6b-s7lrw_cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b/prom-label-proxy/0.log" Sep 17 19:32:03.514216 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.514128 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8f64dc6b-s7lrw_cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b/kube-rbac-proxy-rules/0.log" Sep 17 19:32:03.554117 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:03.554083 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8f64dc6b-s7lrw_cbdd9212-df5c-4e6b-ba3e-5ab0f902aa5b/kube-rbac-proxy-metrics/0.log" Sep 17 19:32:06.514868 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.514762 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-qr9pk_1b07205e-a3bc-492d-a02f-53974766a4fc/volume-data-source-validator/0.log" Sep 17 19:32:06.836409 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.836256 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk"] Sep 17 19:32:06.836870 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.836848 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="gather" Sep 17 19:32:06.836986 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.836874 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="gather" Sep 17 19:32:06.836986 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.836897 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="copy" Sep 17 19:32:06.836986 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.836906 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="copy" Sep 17 19:32:06.837141 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.837033 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="copy" Sep 17 19:32:06.837141 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.837049 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda76fae-32f8-40ea-8bd0-aef9e3b8c7b2" containerName="gather" Sep 17 19:32:06.840593 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.840564 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:06.843214 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.843180 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sms2k\"/\"openshift-service-ca.crt\"" Sep 17 19:32:06.843214 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.843181 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sms2k\"/\"kube-root-ca.crt\"" Sep 17 19:32:06.843884 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.843868 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sms2k\"/\"default-dockercfg-2v6r8\"" Sep 17 19:32:06.852371 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.852331 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk"] Sep 17 19:32:06.966866 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.966816 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-podres\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:06.966866 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.966867 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-sys\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:06.967136 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.966886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-proc\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:06.967136 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.967040 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-lib-modules\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:06.967136 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:06.967077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbr5d\" (UniqueName: \"kubernetes.io/projected/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-kube-api-access-nbr5d\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.067695 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067623 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-lib-modules\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.067695 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067687 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbr5d\" (UniqueName: \"kubernetes.io/projected/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-kube-api-access-nbr5d\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067739 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-podres\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067782 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-sys\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067805 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-proc\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067880 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-lib-modules\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067900 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-proc\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067900 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-sys\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.068024 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.067935 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-podres\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.077324 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.077288 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbr5d\" (UniqueName: \"kubernetes.io/projected/5e60fa50-6aae-451e-bde7-5b7bf81e64ad-kube-api-access-nbr5d\") pod \"perf-node-gather-daemonset-jhtwk\" (UID: \"5e60fa50-6aae-451e-bde7-5b7bf81e64ad\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.158779 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.158610 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:07.452048 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.451979 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk"] Sep 17 19:32:07.455659 ip-10-0-136-140 kubenswrapper[2552]: W0917 19:32:07.455623 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e60fa50_6aae_451e_bde7_5b7bf81e64ad.slice/crio-4630c2f0cd5778d5597984481c0858216719675906b4d256dbf509513789f425 WatchSource:0}: Error finding container 4630c2f0cd5778d5597984481c0858216719675906b4d256dbf509513789f425: Status 404 returned error can't find the container with id 4630c2f0cd5778d5597984481c0858216719675906b4d256dbf509513789f425 Sep 17 19:32:07.589177 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.589135 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vs6h9_531f734e-7128-4036-ba93-4b83442841b4/dns/0.log" Sep 17 19:32:07.612895 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.612832 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vs6h9_531f734e-7128-4036-ba93-4b83442841b4/kube-rbac-proxy/0.log" Sep 17 19:32:07.697081 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:07.697029 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqw9r_bcd8807d-feac-49a0-a8ad-9a106f894cf3/dns-node-resolver/0.log" Sep 17 19:32:08.092615 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:08.092561 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" event={"ID":"5e60fa50-6aae-451e-bde7-5b7bf81e64ad","Type":"ContainerStarted","Data":"7ab8caa43167efe78567afbbd68938ed0f38371cdbb84e8fc41118a8f11a7b99"} Sep 17 19:32:08.092946 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:08.092651 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" event={"ID":"5e60fa50-6aae-451e-bde7-5b7bf81e64ad","Type":"ContainerStarted","Data":"4630c2f0cd5778d5597984481c0858216719675906b4d256dbf509513789f425"} Sep 17 19:32:08.092946 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:08.092691 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:08.111829 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:08.111734 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" podStartSLOduration=2.111711132 podStartE2EDuration="2.111711132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:32:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:32:08.109833283 +0000 UTC m=+3184.342407308" watchObservedRunningTime="2026-09-17 19:32:08.111711132 +0000 UTC m=+3184.344285157" Sep 17 19:32:08.281939 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:08.281904 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq4qh_86c0d143-f169-4d57-9e63-a38a05dfa978/node-ca/0.log" Sep 17 19:32:09.054917 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:09.054877 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c69558c48-czg5x_6a996323-0a99-46cf-9c16-60932faa1015/router/0.log" Sep 17 19:32:09.405257 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:09.405140 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k7ncr_40341bcb-836b-4800-b641-591c8e03e648/serve-healthcheck-canary/0.log" Sep 17 19:32:09.913711 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:09.913678 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wnd4_4d5e8df7-6423-4589-b406-b67cfd1805b0/kube-rbac-proxy/0.log" Sep 17 19:32:09.938337 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:09.938302 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wnd4_4d5e8df7-6423-4589-b406-b67cfd1805b0/exporter/0.log" Sep 17 19:32:09.958666 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:09.958635 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wnd4_4d5e8df7-6423-4589-b406-b67cfd1805b0/extractor/0.log" Sep 17 19:32:12.605096 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:12.605051 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qkpnb_ff3dfdb3-4622-4427-8da3-3221907d5e02/s3-init/0.log" Sep 17 19:32:12.623060 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:12.623026 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qkpnb_ff3dfdb3-4622-4427-8da3-3221907d5e02/download-hf-model/0.log" Sep 17 19:32:14.108688 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:14.108643 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-jhtwk" Sep 17 19:32:18.366700 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.366665 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/kube-multus-additional-cni-plugins/0.log" Sep 17 19:32:18.398156 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.398125 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/egress-router-binary-copy/0.log" Sep 17 19:32:18.422895 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.422863 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/cni-plugins/0.log" Sep 17 19:32:18.452148 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.452109 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/bond-cni-plugin/0.log" Sep 17 19:32:18.475334 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.475298 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/routeoverride-cni/0.log" Sep 17 19:32:18.498171 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.498141 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/whereabouts-cni-bincopy/0.log" Sep 17 19:32:18.520988 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.520949 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wgpw8_3486c21b-a0a7-4f9e-8543-be20f1939cb0/whereabouts-cni/0.log" Sep 17 19:32:18.859175 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.859134 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-slrz2_75e3af6c-dab4-421b-8c64-a3341251b356/kube-multus/0.log" Sep 17 19:32:18.996000 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:18.995971 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tzrr8_66bf0137-1227-44aa-a252-3dfaea381b1f/network-metrics-daemon/0.log" Sep 17 19:32:19.020335 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.020306 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tzrr8_66bf0137-1227-44aa-a252-3dfaea381b1f/kube-rbac-proxy/0.log" Sep 17 19:32:19.811512 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.811470 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-controller/0.log" Sep 17 19:32:19.835945 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.835891 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/1.log" Sep 17 19:32:19.835945 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.835901 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovn-acl-logging/0.log" Sep 17 19:32:19.858378 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.858345 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/kube-rbac-proxy-node/0.log" Sep 17 19:32:19.883573 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.883521 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 19:32:19.903776 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.903728 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/northd/0.log" Sep 17 19:32:19.926069 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.926039 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/nbdb/0.log" Sep 17 19:32:19.950338 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.950286 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/sbdb/0.log" Sep 17 19:32:19.992475 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:19.992433 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cx9tc_fdb9f126-c797-42cf-95b7-fb6e386a837d/ovnkube-controller/0.log" Sep 17 19:32:21.443974 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:21.443914 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vq7nq_e25a1940-8018-4b12-9f2e-3da21ee6fd9a/network-check-target-container/0.log" Sep 17 19:32:22.517103 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:22.517068 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lrb2l_c93fb9c1-3b52-40c3-9de8-ddfa9b4567d8/iptables-alerter/0.log" Sep 17 19:32:23.264063 ip-10-0-136-140 kubenswrapper[2552]: I0917 19:32:23.264027 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mzmsh_32458501-95c6-4f9c-8455-8ca5a33f6fc3/tuned/0.log"