Sep 11 20:44:23.812178 ip-10-0-140-21 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 11 20:44:23.812188 ip-10-0-140-21 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 11 20:44:23.812195 ip-10-0-140-21 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 11 20:44:23.812366 ip-10-0-140-21 systemd[1]: Failed to start Kubernetes Kubelet. Sep 11 20:44:34.033732 ip-10-0-140-21 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 11 20:44:34.033753 ip-10-0-140-21 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 056efa8141664981af68cc3b40c2045c -- Sep 11 20:46:23.635852 ip-10-0-140-21 systemd[1]: Starting Kubernetes Kubelet... Sep 11 20:46:24.018835 ip-10-0-140-21 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 20:46:24.018835 ip-10-0-140-21 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 20:46:24.018835 ip-10-0-140-21 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 20:46:24.018835 ip-10-0-140-21 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 20:46:24.018835 ip-10-0-140-21 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 20:46:24.020055 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.019971 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 20:46:24.023681 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023665 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 20:46:24.023681 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023681 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023685 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023689 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023692 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023695 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023698 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023701 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023704 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023707 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023710 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023712 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023715 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023723 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023726 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023729 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023731 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023734 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023737 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023739 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023742 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 20:46:24.023745 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023745 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023748 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023751 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023753 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023756 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023759 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023762 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023764 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023767 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023769 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023772 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023775 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023777 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023779 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023782 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023784 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023787 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023789 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023792 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023795 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 20:46:24.024218 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023797 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023800 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023802 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023805 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023807 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023810 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023813 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023815 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023818 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023820 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023822 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023825 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023827 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023830 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023833 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023836 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023839 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023841 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023844 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023846 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 20:46:24.024760 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023849 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023851 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023854 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023857 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023859 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023861 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023865 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023869 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023873 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023877 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023880 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023884 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023886 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023889 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023891 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023895 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023897 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023900 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023902 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 20:46:24.025249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023905 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023907 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023910 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023912 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023915 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023917 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023920 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023923 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023926 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023929 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023931 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023935 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023939 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023942 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023945 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023947 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023950 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023952 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.023955 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 20:46:24.025727 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024645 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024652 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024655 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024658 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024660 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024663 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024666 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024669 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024672 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024675 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024678 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024680 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024683 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024685 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024690 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024693 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024696 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024699 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024702 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 20:46:24.026186 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024704 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024708 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024711 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024714 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024716 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024719 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024721 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024724 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024726 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024729 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024731 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024734 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024736 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024739 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024742 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024744 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024747 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024749 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024752 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024754 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 20:46:24.026679 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024757 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024760 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024763 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024765 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024768 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024771 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024774 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024777 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024779 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024782 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024785 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024787 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024792 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024795 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024798 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024800 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024803 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024805 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024808 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024811 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 20:46:24.027180 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024813 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024816 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024819 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024821 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024824 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024826 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024829 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024831 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024834 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024836 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024839 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024841 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024843 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024846 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024849 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024853 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024856 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024860 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024863 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024865 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 20:46:24.027678 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024867 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024870 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024873 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024875 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024879 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024882 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024885 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024887 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024890 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024892 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024895 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024898 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024900 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024903 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024905 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024908 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024910 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024914 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024917 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 20:46:24.028164 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.024920 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025281 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025286 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025289 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025292 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025294 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025298 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025301 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025304 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025306 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025308 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025311 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025313 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025316 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025319 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025321 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025324 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025328 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025331 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 20:46:24.028660 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025335 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025340 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025343 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025346 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025349 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025352 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025355 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025358 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025361 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025363 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025367 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025370 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025373 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025375 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025378 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025381 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025383 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025386 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025388 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025391 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 20:46:24.029126 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025394 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025398 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025401 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025404 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025406 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025409 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025412 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025414 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025417 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025420 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025425 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025428 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025431 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025434 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025436 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025439 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025442 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025444 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025447 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 20:46:24.029623 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025449 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025452 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025454 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025457 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025459 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025462 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025464 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025467 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025469 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025472 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025474 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025477 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025480 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025482 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025486 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025488 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025491 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025493 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025496 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025498 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 20:46:24.030096 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025500 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025503 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025505 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025509 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025514 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025516 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025519 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025522 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025524 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025527 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025529 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025532 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025534 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025537 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025553 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025556 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025559 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025561 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025564 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025567 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 20:46:24.030599 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025569 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.025572 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025652 2560 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025698 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025705 2560 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025710 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025713 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025717 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025721 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025726 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025729 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025732 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025735 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025739 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025743 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025747 2560 flags.go:64] FLAG: --cgroup-root="" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025751 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025754 2560 flags.go:64] FLAG: --client-ca-file="" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025757 2560 flags.go:64] FLAG: --cloud-provider="external" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025760 2560 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025764 2560 flags.go:64] FLAG: --cluster-domain="" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025767 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025770 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025773 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 20:46:24.031075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025776 2560 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025780 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025783 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025786 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025789 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025792 2560 flags.go:64] FLAG: --contention-profiling="false" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025795 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025798 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025801 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025804 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025808 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025811 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025814 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025817 2560 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025820 2560 flags.go:64] FLAG: --enable-server="true" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025823 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025828 2560 flags.go:64] FLAG: --event-burst="100" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025831 2560 flags.go:64] FLAG: --event-qps="50" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025834 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025837 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025840 2560 flags.go:64] FLAG: --eviction-hard="" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025844 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025847 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025850 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025854 2560 flags.go:64] FLAG: --eviction-soft="" Sep 11 20:46:24.031697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025857 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025860 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025863 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025866 2560 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025868 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025871 2560 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025874 2560 flags.go:64] FLAG: --feature-gates="" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025878 2560 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025881 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025884 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025887 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025890 2560 flags.go:64] FLAG: --healthz-port="10248" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025893 2560 flags.go:64] FLAG: --help="false" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025896 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025900 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025903 2560 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025906 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025909 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025912 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025915 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025918 2560 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025921 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025924 2560 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 20:46:24.032374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025926 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025930 2560 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025933 2560 flags.go:64] FLAG: --kube-reserved="" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025936 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025939 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025942 2560 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025945 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025948 2560 flags.go:64] FLAG: --lock-file="" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025952 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025955 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025958 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025964 2560 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025967 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025969 2560 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025972 2560 flags.go:64] FLAG: --logging-format="text" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025975 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025979 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025982 2560 flags.go:64] FLAG: --manifest-url="" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025985 2560 flags.go:64] FLAG: --manifest-url-header="" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025989 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025992 2560 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025996 2560 flags.go:64] FLAG: --max-pods="110" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.025999 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026002 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026005 2560 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 20:46:24.033016 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026008 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026011 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026014 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026017 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026024 2560 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026027 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026030 2560 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026033 2560 flags.go:64] FLAG: --pod-cidr="" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026035 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026041 2560 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026044 2560 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026047 2560 flags.go:64] FLAG: --pods-per-core="0" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026050 2560 flags.go:64] FLAG: --port="10250" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026053 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026056 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051b5d5bf1be00b1b" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026059 2560 flags.go:64] FLAG: --qos-reserved="" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026064 2560 flags.go:64] FLAG: --read-only-port="10255" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026067 2560 flags.go:64] FLAG: --register-node="true" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026070 2560 flags.go:64] FLAG: --register-with-taints="" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026074 2560 flags.go:64] FLAG: --registry-burst="10" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026076 2560 flags.go:64] FLAG: --registry-qps="5" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026079 2560 flags.go:64] FLAG: --reserved-cpus="" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026082 2560 flags.go:64] FLAG: --reserved-memory="" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026086 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026089 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 20:46:24.033996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026092 2560 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026095 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026098 2560 flags.go:64] FLAG: --runonce="false" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026101 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026104 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026107 2560 flags.go:64] FLAG: --seccomp-default="false" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026111 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026114 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026117 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026120 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026123 2560 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026126 2560 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026129 2560 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026132 2560 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026134 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026137 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026140 2560 flags.go:64] FLAG: --system-cgroups="" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026143 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026149 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026152 2560 flags.go:64] FLAG: --tls-cert-file="" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026154 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026158 2560 flags.go:64] FLAG: --tls-min-version="" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026161 2560 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026165 2560 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026168 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 20:46:24.034716 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026171 2560 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026174 2560 flags.go:64] FLAG: --v="2" Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026178 2560 flags.go:64] FLAG: --version="false" Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026185 2560 flags.go:64] FLAG: --vmodule="" Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026189 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.026192 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026313 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026318 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026322 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026325 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026328 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026330 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026333 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026338 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026341 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026344 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026346 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026349 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026352 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026354 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 20:46:24.035330 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026357 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026360 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026362 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026365 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026367 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026370 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026373 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026376 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026380 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026383 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026388 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026390 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026393 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026396 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026399 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026402 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026405 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026408 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026410 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 20:46:24.035866 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026413 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026415 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026418 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026420 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026423 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026429 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026434 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026437 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026440 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026442 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026445 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026448 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026450 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026453 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026456 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026458 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026461 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026463 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026466 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026469 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 20:46:24.036335 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026472 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026474 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026477 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026481 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026483 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026486 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026488 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026491 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026494 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026497 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026501 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026504 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026507 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026510 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026512 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026515 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026517 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026520 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026524 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026526 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 20:46:24.036905 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026529 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026531 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026534 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026537 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026551 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026554 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026557 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026560 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026562 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026565 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026567 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026570 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026573 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026576 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026578 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026583 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026585 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026588 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026591 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026593 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 20:46:24.037403 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026596 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026598 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026601 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026604 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026607 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.026609 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.027155 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.035201 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.035316 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.037055 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.037063 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037122 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037128 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037132 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037135 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 20:46:24.037898 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037137 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037140 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037143 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037146 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037150 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037152 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037155 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037158 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037161 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037165 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037169 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037173 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037176 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037179 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037181 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037184 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037187 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037189 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037192 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 20:46:24.038290 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037195 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037197 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037201 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037204 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037207 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037210 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037214 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037218 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037222 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037225 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037228 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037231 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037234 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037237 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037240 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037242 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037245 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037248 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037250 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 20:46:24.038770 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037253 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037256 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037258 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037261 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037264 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037266 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037270 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037273 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037276 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037279 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037282 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037285 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037288 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037290 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037293 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037296 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037299 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037301 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037304 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037306 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 20:46:24.039266 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037309 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037311 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037314 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037317 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037319 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037321 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037324 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037326 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037329 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037331 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037334 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037336 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037339 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037342 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037344 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037347 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037349 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037352 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037355 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037357 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 20:46:24.039775 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037360 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037363 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037365 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037368 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037370 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037373 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037376 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037379 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037382 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037384 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037387 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037390 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037392 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037395 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037398 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037400 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 20:46:24.040260 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037403 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.037408 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037521 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037526 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037529 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037532 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037534 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037537 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037552 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037555 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037558 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037560 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037563 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037566 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037570 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 20:46:24.040673 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037572 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037575 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037578 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037580 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037583 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037586 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037589 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037592 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037595 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037598 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037601 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037603 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037606 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037608 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037611 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037615 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037619 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037622 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037625 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 20:46:24.041047 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037629 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037632 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037635 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037638 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037640 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037643 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037646 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037649 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037651 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037653 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037656 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037659 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037661 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037664 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037667 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037669 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037672 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037674 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037677 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037679 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 20:46:24.041526 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037682 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037685 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037687 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037690 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037692 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037695 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037698 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037700 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037703 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037705 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037708 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037712 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037715 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037718 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037721 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037724 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037727 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037729 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037732 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037734 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 20:46:24.042051 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037737 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037739 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037742 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037744 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037747 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037749 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037752 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037755 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037758 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037760 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037763 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037765 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037768 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037771 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037773 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037776 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037778 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037781 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037783 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 20:46:24.042561 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037786 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037788 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037791 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037793 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037796 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037799 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037801 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:24.037803 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.037809 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.037921 2560 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.041419 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.042523 2560 server.go:1019] "Starting client certificate rotation" Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.042642 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 20:46:24.043037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.042671 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 20:46:24.045079 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.045066 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 20:46:24.046581 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.046563 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 20:46:24.057838 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.057822 2560 log.go:25] "Validated CRI v1 runtime API" Sep 11 20:46:24.060710 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.060696 2560 log.go:25] "Validated CRI v1 image API" Sep 11 20:46:24.061552 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.061528 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 20:46:24.066092 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.066074 2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85b6f916-69e9-4bd0-bbb4-0cfe92ee7b54:/dev/nvme0n1p4 9ba0132f-022c-4ad2-ae4f-65c1e1a31963:/dev/nvme0n1p3] Sep 11 20:46:24.066140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.066092 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 20:46:24.073094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.072323 2560 manager.go:216] Machine: {Timestamp:2026-09-11 20:46:24.070142574 +0000 UTC m=+0.323314626 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106131 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258291c4dae41b23a2a87da07b7664 SystemUUID:ec258291-c4da-e41b-23a2-a87da07b7664 BootID:056efa81-4166-4981-af68-cc3b40c2045c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:cc:ed:4a:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:cc:ed:4a:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:18:65:98:ae:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 20:46:24.073094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.073087 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 20:46:24.073206 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.073199 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 20:46:24.077196 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.076984 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 20:46:24.077378 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.077359 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 20:46:24.077422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.077204 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 20:46:24.078616 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.078602 2560 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 20:46:24.078658 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.078620 2560 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 20:46:24.078658 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.078628 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 20:46:24.079272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.079259 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 20:46:24.080108 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.080098 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 20:46:24.083796 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083784 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 11 20:46:24.083915 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083905 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 20:46:24.083951 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083934 2560 kubelet.go:486] "Attempting to sync node with API server" Sep 11 20:46:24.083951 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083944 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 20:46:24.084018 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083954 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 20:46:24.084018 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083962 2560 kubelet.go:398] "Adding apiserver pod source" Sep 11 20:46:24.084018 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.083972 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 20:46:24.084377 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.084364 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 20:46:24.084414 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.084387 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 20:46:24.087557 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.087522 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 20:46:24.089518 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.089502 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 20:46:24.089581 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.089535 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 20:46:24.091083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091066 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 20:46:24.091083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091083 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091090 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091096 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091104 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091110 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091123 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091128 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091135 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091140 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091148 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 20:46:24.091219 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091154 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 20:46:24.091895 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091885 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 20:46:24.091895 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.091893 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 20:46:24.092107 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.092082 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 20:46:24.092162 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.092088 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 20:46:24.093418 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.093397 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkvc7" Sep 11 20:46:24.094375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.094357 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 20:46:24.095661 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.095646 2560 server.go:1268] "Started kubelet" Sep 11 20:46:24.095742 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.095691 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 20:46:24.095786 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.095727 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 20:46:24.095823 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.095800 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 20:46:24.096697 ip-10-0-140-21 systemd[1]: Started Kubernetes Kubelet. Sep 11 20:46:24.097428 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.097357 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 20:46:24.098239 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.098227 2560 server.go:310] "Adding debug handlers to kubelet server" Sep 11 20:46:24.100750 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.100645 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkvc7" Sep 11 20:46:24.101345 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.101326 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 20:46:24.103061 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.102048 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-21.ec2.internal.18d45f2990814e99 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-21.ec2.internal,UID:ip-10-0-140-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-21.ec2.internal,},FirstTimestamp:2026-09-11 20:46:24.095620761 +0000 UTC m=+0.348792813,LastTimestamp:2026-09-11 20:46:24.095620761 +0000 UTC m=+0.348792813,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-21.ec2.internal,}" Sep 11 20:46:24.104684 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.104664 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 20:46:24.104684 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.104679 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 20:46:24.104890 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.104870 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.105561 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105534 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 20:46:24.105681 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105664 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 20:46:24.105783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105533 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 20:46:24.105783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105771 2560 reconstruct.go:97] "Volume reconstruction finished" Sep 11 20:46:24.105783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105784 2560 reconciler.go:29] "Reconciler: start to sync state" Sep 11 20:46:24.105983 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105967 2560 factory.go:153] Registering CRI-O factory Sep 11 20:46:24.105983 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.105983 2560 factory.go:223] Registration of the crio container factory successfully Sep 11 20:46:24.106102 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.106025 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 20:46:24.106102 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.106033 2560 factory.go:55] Registering systemd factory Sep 11 20:46:24.106102 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.106038 2560 factory.go:223] Registration of the systemd container factory successfully Sep 11 20:46:24.106102 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.106049 2560 factory.go:103] Registering Raw factory Sep 11 20:46:24.106102 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.106058 2560 manager.go:1196] Started watching for new ooms in manager Sep 11 20:46:24.106335 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.106325 2560 manager.go:349] Starting recovery of all containers Sep 11 20:46:24.110477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.110452 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:24.116046 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.116022 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-21.ec2.internal\" not found" node="ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.119857 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.119839 2560 manager.go:354] Recovery completed Sep 11 20:46:24.122648 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.122618 2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 11 20:46:24.126310 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.126295 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.128251 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128236 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.128324 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128270 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.128324 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128284 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.128850 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128825 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 20:46:24.128850 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128839 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.128989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128840 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 20:46:24.128989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.128905 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 11 20:46:24.129677 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.129662 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.129746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.129687 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.129746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.129696 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.131138 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.131126 2560 policy_none.go:49] "None policy: Start" Sep 11 20:46:24.131185 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.131141 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 20:46:24.131185 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.131151 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 20:46:24.133120 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.133104 2560 policy_none.go:47] "Start" Sep 11 20:46:24.199253 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.199225 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 20:46:24.201382 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.200384 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 20:46:24.201382 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.200431 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 20:46:24.201382 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.200455 2560 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 20:46:24.201382 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.200582 2560 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 11 20:46:24.202915 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.202897 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:24.205598 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.205584 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.272646 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.272581 2560 manager.go:337] "Starting Device Plugin manager" Sep 11 20:46:24.272646 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.272629 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 20:46:24.272646 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.272640 2560 server.go:87] "Starting device plugin registration server" Sep 11 20:46:24.272932 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.272920 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 20:46:24.272982 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.272933 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 20:46:24.273071 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.273044 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 20:46:24.273143 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.273121 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 20:46:24.273143 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.273134 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 20:46:24.273765 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.273741 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 20:46:24.273846 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.273801 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.300683 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.300652 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal"] Sep 11 20:46:24.300790 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.300717 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.302686 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.302668 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.302778 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.302700 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.302778 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.302713 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.305060 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.305045 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.305190 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.305173 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.305251 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.305202 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.306670 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306654 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.306670 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306661 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306683 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306687 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306699 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306702 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dad58467d753112c5733ab02ffa92d87-config\") pod \"kube-apiserver-proxy-ip-10-0-140-21.ec2.internal\" (UID: \"dad58467d753112c5733ab02ffa92d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/858e19b602c8b52b1cec4fc039dfc853-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal\" (UID: \"858e19b602c8b52b1cec4fc039dfc853\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.306842 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.306766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/858e19b602c8b52b1cec4fc039dfc853-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal\" (UID: \"858e19b602c8b52b1cec4fc039dfc853\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.308982 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.308961 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.309073 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.308993 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.310384 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.310366 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.310455 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.310401 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.310455 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.310417 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.332208 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.332183 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-21.ec2.internal\" not found" node="ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.336504 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.336487 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-21.ec2.internal\" not found" node="ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.373151 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.373122 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 20:46:24.374028 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.374009 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientMemory" Sep 11 20:46:24.374107 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.374045 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 20:46:24.374107 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.374061 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeHasSufficientPID" Sep 11 20:46:24.374107 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.374086 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.379300 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.379287 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.379342 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.379306 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-21.ec2.internal\": node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.392754 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.392739 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.407067 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.407048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/858e19b602c8b52b1cec4fc039dfc853-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal\" (UID: \"858e19b602c8b52b1cec4fc039dfc853\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.407115 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.407078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/858e19b602c8b52b1cec4fc039dfc853-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal\" (UID: \"858e19b602c8b52b1cec4fc039dfc853\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.407115 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.407095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dad58467d753112c5733ab02ffa92d87-config\") pod \"kube-apiserver-proxy-ip-10-0-140-21.ec2.internal\" (UID: \"dad58467d753112c5733ab02ffa92d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.407187 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.407119 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dad58467d753112c5733ab02ffa92d87-config\") pod \"kube-apiserver-proxy-ip-10-0-140-21.ec2.internal\" (UID: \"dad58467d753112c5733ab02ffa92d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.407187 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.407135 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/858e19b602c8b52b1cec4fc039dfc853-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal\" (UID: \"858e19b602c8b52b1cec4fc039dfc853\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.407187 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.407143 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/858e19b602c8b52b1cec4fc039dfc853-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal\" (UID: \"858e19b602c8b52b1cec4fc039dfc853\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.493268 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.493228 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.594042 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.593956 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.634412 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.634388 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.639601 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:24.639287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" Sep 11 20:46:24.694937 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.694909 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:24.795436 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:24.795396 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:26.215741 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.215706 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:26.316222 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.316185 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-21.ec2.internal\" not found" Sep 11 20:46:26.329074 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.329055 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:26.361892 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.361858 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 20:46:26.362498 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.362008 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 20:46:26.362498 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.362033 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 20:46:26.362498 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.362038 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 20:46:26.404286 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.404143 2560 apiserver.go:52] "Watching apiserver" Sep 11 20:46:26.425284 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.425189 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 20:46:26.425284 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.425197 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" Sep 11 20:46:26.425284 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.425209 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 20:41:25 +0000 UTC" deadline="2028-05-08 17:04:02.449266016 +0000 UTC" Sep 11 20:46:26.425284 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.425259 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14516h17m36.024011288s" Sep 11 20:46:26.425582 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.425417 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 20:46:26.427522 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.427494 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-jxc9v","openshift-network-operator/iptables-alerter-gvh85","kube-system/konnectivity-agent-47xhm","openshift-cluster-node-tuning-operator/tuned-pct25","openshift-image-registry/node-ca-gffmh","openshift-multus/multus-cmtr2","openshift-multus/network-metrics-daemon-xzslg","openshift-network-diagnostics/network-check-target-xccmr","openshift-ovn-kubernetes/ovnkube-node-9p946","kube-system/global-pull-secret-syncer-hsn6q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q","openshift-dns/node-resolver-hg6vw"] Sep 11 20:46:26.430115 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.430074 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.432421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432161 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.432421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432293 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.432421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432351 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2tp5g\"" Sep 11 20:46:26.432421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432389 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 20:46:26.432679 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432472 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 20:46:26.432679 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432500 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 20:46:26.432679 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.432558 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.434080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.434060 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.434461 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.434444 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6j8q7\"" Sep 11 20:46:26.434559 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.434450 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.434559 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.434516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.434671 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.434610 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 20:46:26.435265 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.435251 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 20:46:26.435360 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.435347 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" Sep 11 20:46:26.436400 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.436385 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 20:46:26.436504 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.436488 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rqj2h\"" Sep 11 20:46:26.436562 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.436521 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 20:46:26.436627 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.436612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.437201 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.437185 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 20:46:26.438600 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.438583 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.438664 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.438608 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.438664 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.438619 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m4znr\"" Sep 11 20:46:26.438809 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.438797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.440654 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.440639 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-66k5s\"" Sep 11 20:46:26.440912 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.440898 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.440993 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.440930 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.440993 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.440930 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 20:46:26.441095 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.440998 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.443196 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.443178 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:26.443271 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.443239 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:26.443438 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.443426 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gl76k\"" Sep 11 20:46:26.443478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.443458 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 20:46:26.444060 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.444046 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 20:46:26.445285 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.445271 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:26.445384 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.445347 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:26.447548 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.447532 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.449606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.449584 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 20:46:26.449695 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.449644 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.449695 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.449683 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 20:46:26.450039 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.450019 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4sbh5\"" Sep 11 20:46:26.450145 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.450129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.450205 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.450188 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 20:46:26.450262 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.450228 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:26.450579 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.450561 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 20:46:26.450668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.450561 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.452367 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.452351 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.455754 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.455467 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.455754 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.455512 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.455754 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.455574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 20:46:26.455939 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.455757 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fxwlm\"" Sep 11 20:46:26.456332 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.456242 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal"] Sep 11 20:46:26.456422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.456350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.456422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.456403 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal"] Sep 11 20:46:26.458224 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.458207 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 20:46:26.458352 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.458339 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8llvj\"" Sep 11 20:46:26.458606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.458586 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 20:46:26.459656 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.459638 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ttznf" Sep 11 20:46:26.469850 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.469833 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ttznf" Sep 11 20:46:26.526445 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.526428 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 20:46:26.531141 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.531232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-systemd\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-system-cni-dir\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.531232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.531232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-socket-dir-parent\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-hostroot\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-cni-bin\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgts2\" (UniqueName: \"kubernetes.io/projected/6705b5d7-c96e-49ac-a820-817edde97ca2-kube-api-access-fgts2\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysconfig\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63f266a3-8f0d-40b0-8794-38257bf5965c-serviceca\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgw6\" (UniqueName: \"kubernetes.io/projected/63f266a3-8f0d-40b0-8794-38257bf5965c-kube-api-access-chgw6\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c456dbc-99f2-4a81-a556-fbf0bbbed523-cni-binary-copy\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-env-overrides\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.531477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-dbus\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm4mr\" (UniqueName: \"kubernetes.io/projected/eceef04f-754d-4de0-aada-8331db96c92a-kube-api-access-sm4mr\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-cnibin\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531526 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-conf-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-etc-kubernetes\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-etc-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-sys-fs\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpq5t\" (UniqueName: \"kubernetes.io/projected/3a736981-daee-47f0-a35c-2d3979edac8b-kube-api-access-qpq5t\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531661 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-var-lib-kubelet\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eceef04f-754d-4de0-aada-8331db96c92a-tmp\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63f266a3-8f0d-40b0-8794-38257bf5965c-host\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531740 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1322470e-4e4c-4618-9fd0-be94e6fe37c1-hosts-file\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-kubernetes\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-run\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-netns\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.531869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-cnibin\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm9gp\" (UniqueName: \"kubernetes.io/projected/dba4cda1-287c-4eba-8316-0fa1100249ba-kube-api-access-xm9gp\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-daemon-config\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-log-socket\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-systemd-units\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.531980 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-systemd\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532050 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-ovnkube-config\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysctl-conf\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-cni-netd\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6705b5d7-c96e-49ac-a820-817edde97ca2-ovn-node-metrics-cert\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-registration-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rshqk\" (UniqueName: \"kubernetes.io/projected/1322470e-4e4c-4618-9fd0-be94e6fe37c1-kube-api-access-rshqk\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/403c152a-7714-4132-9b87-4364739ee54a-host-slash\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8692ca9c-f056-40d5-b15e-c0ea8b69627f-agent-certs\") pod \"konnectivity-agent-47xhm\" (UID: \"8692ca9c-f056-40d5-b15e-c0ea8b69627f\") " pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.532422 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-cni-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-kubelet-config\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-device-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-multus-certs\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532357 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq2fs\" (UniqueName: \"kubernetes.io/projected/8c456dbc-99f2-4a81-a556-fbf0bbbed523-kube-api-access-jq2fs\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-kubelet\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5gn\" (UniqueName: \"kubernetes.io/projected/e02b51b0-219a-43d0-b1a6-d899d810b803-kube-api-access-mg5gn\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-ovn\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5zr9\" (UniqueName: \"kubernetes.io/projected/403c152a-7714-4132-9b87-4364739ee54a-kube-api-access-p5zr9\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-sys\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-host\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532490 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eceef04f-754d-4de0-aada-8331db96c92a-etc-tuned\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-slash\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.532987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-modprobe-d\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-system-cni-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-k8s-cni-cncf-io\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-var-lib-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1322470e-4e4c-4618-9fd0-be94e6fe37c1-tmp-dir\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/403c152a-7714-4132-9b87-4364739ee54a-iptables-alerter-script\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-lib-modules\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-cni-bin\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-cni-multus\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-socket-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8692ca9c-f056-40d5-b15e-c0ea8b69627f-konnectivity-ca\") pod \"konnectivity-agent-47xhm\" (UID: \"8692ca9c-f056-40d5-b15e-c0ea8b69627f\") " pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysctl-d\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-kubelet\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-run-netns\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-node-log\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.533529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532926 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-ovnkube-script-lib\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.533979 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.532945 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.560401 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.560371 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858e19b602c8b52b1cec4fc039dfc853.slice/crio-0e5e68509bd1847d6f43c80209b700baed59fb7f0cc812ae489d81d3437743e1 WatchSource:0}: Error finding container 0e5e68509bd1847d6f43c80209b700baed59fb7f0cc812ae489d81d3437743e1: Status 404 returned error can't find the container with id 0e5e68509bd1847d6f43c80209b700baed59fb7f0cc812ae489d81d3437743e1 Sep 11 20:46:26.560608 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.560590 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad58467d753112c5733ab02ffa92d87.slice/crio-7eaae9fa9841893f08ecfa1977737562b06d1f32802bd02232d1c75c2a1d0c2e WatchSource:0}: Error finding container 7eaae9fa9841893f08ecfa1977737562b06d1f32802bd02232d1c75c2a1d0c2e: Status 404 returned error can't find the container with id 7eaae9fa9841893f08ecfa1977737562b06d1f32802bd02232d1c75c2a1d0c2e Sep 11 20:46:26.565242 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.565232 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 20:46:26.633961 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.633932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-systemd-units\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.633961 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.633962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-systemd\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634130 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.633979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634130 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-ovnkube-config\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634130 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634039 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-systemd-units\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634130 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634056 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-systemd\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634130 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634067 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634130 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysctl-conf\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634159 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysctl-conf\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634171 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-cni-netd\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6705b5d7-c96e-49ac-a820-817edde97ca2-ovn-node-metrics-cert\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-registration-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-cni-netd\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rshqk\" (UniqueName: \"kubernetes.io/projected/1322470e-4e4c-4618-9fd0-be94e6fe37c1-kube-api-access-rshqk\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/403c152a-7714-4132-9b87-4364739ee54a-host-slash\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.634305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8692ca9c-f056-40d5-b15e-c0ea8b69627f-agent-certs\") pod \"konnectivity-agent-47xhm\" (UID: \"8692ca9c-f056-40d5-b15e-c0ea8b69627f\") " pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-cni-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-kubelet-config\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634375 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/403c152a-7714-4132-9b87-4364739ee54a-host-slash\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-registration-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-device-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634431 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-device-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634456 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-cni-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-multus-certs\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.634510 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634503 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-kubelet-config\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq2fs\" (UniqueName: \"kubernetes.io/projected/8c456dbc-99f2-4a81-a556-fbf0bbbed523-kube-api-access-jq2fs\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-kubelet\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634567 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-multus-certs\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.634579 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:27.134558944 +0000 UTC m=+2.067957979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634573 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 20:46:26.634668 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634592 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-kubelet\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5gn\" (UniqueName: \"kubernetes.io/projected/e02b51b0-219a-43d0-b1a6-d899d810b803-kube-api-access-mg5gn\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634710 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-ovn\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5zr9\" (UniqueName: \"kubernetes.io/projected/403c152a-7714-4132-9b87-4364739ee54a-kube-api-access-p5zr9\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634748 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-ovnkube-config\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-sys\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-host\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634800 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-ovn\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eceef04f-754d-4de0-aada-8331db96c92a-etc-tuned\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-sys\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634891 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-host\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-slash\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.634979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-modprobe-d\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635004 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-slash\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-system-cni-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.635555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-k8s-cni-cncf-io\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-run-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-var-lib-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1322470e-4e4c-4618-9fd0-be94e6fe37c1-tmp-dir\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635109 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-system-cni-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635115 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-modprobe-d\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/403c152a-7714-4132-9b87-4364739ee54a-iptables-alerter-script\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-lib-modules\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635158 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-var-lib-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-cni-bin\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-cni-multus\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635206 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-k8s-cni-cncf-io\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-socket-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635239 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-cni-bin\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8692ca9c-f056-40d5-b15e-c0ea8b69627f-konnectivity-ca\") pod \"konnectivity-agent-47xhm\" (UID: \"8692ca9c-f056-40d5-b15e-c0ea8b69627f\") " pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysctl-d\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-kubelet\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-run-netns\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.636350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635335 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-lib-modules\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-node-log\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-ovnkube-script-lib\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-cni-multus\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-systemd\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635441 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-system-cni-dir\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635495 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-socket-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635499 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-system-cni-dir\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635545 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-var-lib-kubelet\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.635564 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.635616 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:46:27.135601029 +0000 UTC m=+2.069000055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635632 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/403c152a-7714-4132-9b87-4364739ee54a-iptables-alerter-script\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635661 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635705 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-systemd\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.637182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635742 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-run-netns\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635826 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysctl-d\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635868 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-node-log\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635902 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1322470e-4e4c-4618-9fd0-be94e6fe37c1-tmp-dir\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8692ca9c-f056-40d5-b15e-c0ea8b69627f-konnectivity-ca\") pod \"konnectivity-agent-47xhm\" (UID: \"8692ca9c-f056-40d5-b15e-c0ea8b69627f\") " pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-socket-dir-parent\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.635997 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-hostroot\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-cni-bin\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgts2\" (UniqueName: \"kubernetes.io/projected/6705b5d7-c96e-49ac-a820-817edde97ca2-kube-api-access-fgts2\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-socket-dir-parent\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysconfig\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-ovnkube-script-lib\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636107 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-sysconfig\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63f266a3-8f0d-40b0-8794-38257bf5965c-serviceca\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chgw6\" (UniqueName: \"kubernetes.io/projected/63f266a3-8f0d-40b0-8794-38257bf5965c-kube-api-access-chgw6\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-cni-bin\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.638195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c456dbc-99f2-4a81-a556-fbf0bbbed523-cni-binary-copy\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636230 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-env-overrides\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-dbus\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm4mr\" (UniqueName: \"kubernetes.io/projected/eceef04f-754d-4de0-aada-8331db96c92a-kube-api-access-sm4mr\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636299 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-cnibin\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-conf-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-etc-kubernetes\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-etc-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-sys-fs\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpq5t\" (UniqueName: \"kubernetes.io/projected/3a736981-daee-47f0-a35c-2d3979edac8b-kube-api-access-qpq5t\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-var-lib-kubelet\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eceef04f-754d-4de0-aada-8331db96c92a-tmp\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63f266a3-8f0d-40b0-8794-38257bf5965c-host\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1322470e-4e4c-4618-9fd0-be94e6fe37c1-hosts-file\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-kubernetes\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-run\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-netns\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.638923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-cnibin\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636687 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dba4cda1-287c-4eba-8316-0fa1100249ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636710 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636140 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-hostroot\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636715 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6705b5d7-c96e-49ac-a820-817edde97ca2-env-overrides\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm9gp\" (UniqueName: \"kubernetes.io/projected/dba4cda1-287c-4eba-8316-0fa1100249ba-kube-api-access-xm9gp\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636778 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-dbus\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-daemon-config\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-log-socket\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636862 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c456dbc-99f2-4a81-a556-fbf0bbbed523-cni-binary-copy\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636871 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636886 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-log-socket\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63f266a3-8f0d-40b0-8794-38257bf5965c-host\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636964 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636972 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63f266a3-8f0d-40b0-8794-38257bf5965c-serviceca\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.639478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636966 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636999 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dba4cda1-287c-4eba-8316-0fa1100249ba-cnibin\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637013 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1322470e-4e4c-4618-9fd0-be94e6fe37c1-hosts-file\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.636925 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-host-run-netns\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637047 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6705b5d7-c96e-49ac-a820-817edde97ca2-etc-openvswitch\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637051 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-etc-kubernetes\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637067 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-cnibin\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637085 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-conf-dir\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637107 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a736981-daee-47f0-a35c-2d3979edac8b-sys-fs\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637122 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c456dbc-99f2-4a81-a556-fbf0bbbed523-etc-kubernetes\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637148 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-var-lib-kubelet\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637216 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c456dbc-99f2-4a81-a556-fbf0bbbed523-multus-daemon-config\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.637258 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eceef04f-754d-4de0-aada-8331db96c92a-run\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.638351 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6705b5d7-c96e-49ac-a820-817edde97ca2-ovn-node-metrics-cert\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.638365 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8692ca9c-f056-40d5-b15e-c0ea8b69627f-agent-certs\") pod \"konnectivity-agent-47xhm\" (UID: \"8692ca9c-f056-40d5-b15e-c0ea8b69627f\") " pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.638771 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eceef04f-754d-4de0-aada-8331db96c92a-etc-tuned\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.639931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.638966 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eceef04f-754d-4de0-aada-8331db96c92a-tmp\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.644431 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.644302 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5zr9\" (UniqueName: \"kubernetes.io/projected/403c152a-7714-4132-9b87-4364739ee54a-kube-api-access-p5zr9\") pod \"iptables-alerter-gvh85\" (UID: \"403c152a-7714-4132-9b87-4364739ee54a\") " pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.644581 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.644554 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rshqk\" (UniqueName: \"kubernetes.io/projected/1322470e-4e4c-4618-9fd0-be94e6fe37c1-kube-api-access-rshqk\") pod \"node-resolver-hg6vw\" (UID: \"1322470e-4e4c-4618-9fd0-be94e6fe37c1\") " pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.644647 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.644611 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:26.644700 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.644647 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:26.644700 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.644661 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:26.644806 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:26.644749 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:27.144733231 +0000 UTC m=+2.078132241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:26.646802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.646778 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgw6\" (UniqueName: \"kubernetes.io/projected/63f266a3-8f0d-40b0-8794-38257bf5965c-kube-api-access-chgw6\") pod \"node-ca-gffmh\" (UID: \"63f266a3-8f0d-40b0-8794-38257bf5965c\") " pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.647029 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.647006 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq2fs\" (UniqueName: \"kubernetes.io/projected/8c456dbc-99f2-4a81-a556-fbf0bbbed523-kube-api-access-jq2fs\") pod \"multus-cmtr2\" (UID: \"8c456dbc-99f2-4a81-a556-fbf0bbbed523\") " pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.647094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.647063 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpq5t\" (UniqueName: \"kubernetes.io/projected/3a736981-daee-47f0-a35c-2d3979edac8b-kube-api-access-qpq5t\") pod \"aws-ebs-csi-driver-node-wt69q\" (UID: \"3a736981-daee-47f0-a35c-2d3979edac8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.647094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.647065 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5gn\" (UniqueName: \"kubernetes.io/projected/e02b51b0-219a-43d0-b1a6-d899d810b803-kube-api-access-mg5gn\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:26.647433 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.647415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm9gp\" (UniqueName: \"kubernetes.io/projected/dba4cda1-287c-4eba-8316-0fa1100249ba-kube-api-access-xm9gp\") pod \"multus-additional-cni-plugins-jxc9v\" (UID: \"dba4cda1-287c-4eba-8316-0fa1100249ba\") " pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.647498 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.647465 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm4mr\" (UniqueName: \"kubernetes.io/projected/eceef04f-754d-4de0-aada-8331db96c92a-kube-api-access-sm4mr\") pod \"tuned-pct25\" (UID: \"eceef04f-754d-4de0-aada-8331db96c92a\") " pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.647841 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.647826 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgts2\" (UniqueName: \"kubernetes.io/projected/6705b5d7-c96e-49ac-a820-817edde97ca2-kube-api-access-fgts2\") pod \"ovnkube-node-9p946\" (UID: \"6705b5d7-c96e-49ac-a820-817edde97ca2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.657742 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.657726 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:26.756741 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.756655 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" Sep 11 20:46:26.766069 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.766039 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba4cda1_287c_4eba_8316_0fa1100249ba.slice/crio-d6d75ded6fa81b921aa444f017b01b2b13b04c213014a1b0d42e1015c703ae79 WatchSource:0}: Error finding container d6d75ded6fa81b921aa444f017b01b2b13b04c213014a1b0d42e1015c703ae79: Status 404 returned error can't find the container with id d6d75ded6fa81b921aa444f017b01b2b13b04c213014a1b0d42e1015c703ae79 Sep 11 20:46:26.773793 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.773773 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvh85" Sep 11 20:46:26.781237 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.781213 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403c152a_7714_4132_9b87_4364739ee54a.slice/crio-ed5adca3ce7bfcc93927f9fcb06c0ffb7cc7d22d56252ad934a39a67600e1d02 WatchSource:0}: Error finding container ed5adca3ce7bfcc93927f9fcb06c0ffb7cc7d22d56252ad934a39a67600e1d02: Status 404 returned error can't find the container with id ed5adca3ce7bfcc93927f9fcb06c0ffb7cc7d22d56252ad934a39a67600e1d02 Sep 11 20:46:26.789980 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.789963 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:26.797253 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.797234 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8692ca9c_f056_40d5_b15e_c0ea8b69627f.slice/crio-aab07a358a1b6917e8891d4bf7d4c0347222e0e0b5e76c7b6d80c5f7155cc8c2 WatchSource:0}: Error finding container aab07a358a1b6917e8891d4bf7d4c0347222e0e0b5e76c7b6d80c5f7155cc8c2: Status 404 returned error can't find the container with id aab07a358a1b6917e8891d4bf7d4c0347222e0e0b5e76c7b6d80c5f7155cc8c2 Sep 11 20:46:26.812725 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.812706 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pct25" Sep 11 20:46:26.821355 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.821335 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeceef04f_754d_4de0_aada_8331db96c92a.slice/crio-83839a4295311d9747dc6f070f8dc664dfe97a48b11a223f18855607b928341e WatchSource:0}: Error finding container 83839a4295311d9747dc6f070f8dc664dfe97a48b11a223f18855607b928341e: Status 404 returned error can't find the container with id 83839a4295311d9747dc6f070f8dc664dfe97a48b11a223f18855607b928341e Sep 11 20:46:26.826821 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.826805 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gffmh" Sep 11 20:46:26.832003 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.831986 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmtr2" Sep 11 20:46:26.833942 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.833922 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f266a3_8f0d_40b0_8794_38257bf5965c.slice/crio-82bfcea653c62ca7015f5c0a5a36047fe09ccbd1c74db4691ee78e7d9f6d64d1 WatchSource:0}: Error finding container 82bfcea653c62ca7015f5c0a5a36047fe09ccbd1c74db4691ee78e7d9f6d64d1: Status 404 returned error can't find the container with id 82bfcea653c62ca7015f5c0a5a36047fe09ccbd1c74db4691ee78e7d9f6d64d1 Sep 11 20:46:26.839535 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.839515 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c456dbc_99f2_4a81_a556_fbf0bbbed523.slice/crio-dba0106bfdd2a3cac0be64fa8070fc3ee5215fc7abda673e0fdb3a42e38b7005 WatchSource:0}: Error finding container dba0106bfdd2a3cac0be64fa8070fc3ee5215fc7abda673e0fdb3a42e38b7005: Status 404 returned error can't find the container with id dba0106bfdd2a3cac0be64fa8070fc3ee5215fc7abda673e0fdb3a42e38b7005 Sep 11 20:46:26.861706 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.861687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:26.868349 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.868335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" Sep 11 20:46:26.869906 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.869889 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6705b5d7_c96e_49ac_a820_817edde97ca2.slice/crio-022f03d17e2de5652b40c6504a08b84c4f05ed6960ca3416f9b4673e51ff5dca WatchSource:0}: Error finding container 022f03d17e2de5652b40c6504a08b84c4f05ed6960ca3416f9b4673e51ff5dca: Status 404 returned error can't find the container with id 022f03d17e2de5652b40c6504a08b84c4f05ed6960ca3416f9b4673e51ff5dca Sep 11 20:46:26.871671 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:26.871657 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hg6vw" Sep 11 20:46:26.876026 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.876008 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a736981_daee_47f0_a35c_2d3979edac8b.slice/crio-6137b0fa0602e77370ddc2f21457f883eb54460332069665e36a5776048e6340 WatchSource:0}: Error finding container 6137b0fa0602e77370ddc2f21457f883eb54460332069665e36a5776048e6340: Status 404 returned error can't find the container with id 6137b0fa0602e77370ddc2f21457f883eb54460332069665e36a5776048e6340 Sep 11 20:46:26.880167 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:46:26.880149 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1322470e_4e4c_4618_9fd0_be94e6fe37c1.slice/crio-01f0d3003a4118ecdb9fe435aa99cc4a05a6e32751a9f67e06e186bf9a8474d8 WatchSource:0}: Error finding container 01f0d3003a4118ecdb9fe435aa99cc4a05a6e32751a9f67e06e186bf9a8474d8: Status 404 returned error can't find the container with id 01f0d3003a4118ecdb9fe435aa99cc4a05a6e32751a9f67e06e186bf9a8474d8 Sep 11 20:46:27.139773 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.139739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:27.139944 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.139792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:27.139944 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.139892 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:27.139944 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.139898 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:27.140114 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.139948 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:46:28.139929833 +0000 UTC m=+3.073328853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:27.140114 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.139964 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:28.139957191 +0000 UTC m=+3.073356197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:27.240078 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.240045 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:27.240267 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.240171 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:27.240267 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.240187 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:27.240267 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.240197 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:27.240267 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:27.240241 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:28.240228224 +0000 UTC m=+3.173627230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:27.472938 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.472860 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 20:41:26 +0000 UTC" deadline="2028-02-26 04:18:22.623515833 +0000 UTC" Sep 11 20:46:27.472938 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.472897 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12775h31m55.150623663s" Sep 11 20:46:27.477946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.477302 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:27.537117 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.537059 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hg6vw" event={"ID":"1322470e-4e4c-4618-9fd0-be94e6fe37c1","Type":"ContainerStarted","Data":"01f0d3003a4118ecdb9fe435aa99cc4a05a6e32751a9f67e06e186bf9a8474d8"} Sep 11 20:46:27.553532 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.552509 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"022f03d17e2de5652b40c6504a08b84c4f05ed6960ca3416f9b4673e51ff5dca"} Sep 11 20:46:27.567429 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.567349 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmtr2" event={"ID":"8c456dbc-99f2-4a81-a556-fbf0bbbed523","Type":"ContainerStarted","Data":"dba0106bfdd2a3cac0be64fa8070fc3ee5215fc7abda673e0fdb3a42e38b7005"} Sep 11 20:46:27.576886 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.576811 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gffmh" event={"ID":"63f266a3-8f0d-40b0-8794-38257bf5965c","Type":"ContainerStarted","Data":"82bfcea653c62ca7015f5c0a5a36047fe09ccbd1c74db4691ee78e7d9f6d64d1"} Sep 11 20:46:27.582243 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.582153 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pct25" event={"ID":"eceef04f-754d-4de0-aada-8331db96c92a","Type":"ContainerStarted","Data":"83839a4295311d9747dc6f070f8dc664dfe97a48b11a223f18855607b928341e"} Sep 11 20:46:27.597415 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.597386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" event={"ID":"3a736981-daee-47f0-a35c-2d3979edac8b","Type":"ContainerStarted","Data":"6137b0fa0602e77370ddc2f21457f883eb54460332069665e36a5776048e6340"} Sep 11 20:46:27.610230 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.610201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47xhm" event={"ID":"8692ca9c-f056-40d5-b15e-c0ea8b69627f","Type":"ContainerStarted","Data":"aab07a358a1b6917e8891d4bf7d4c0347222e0e0b5e76c7b6d80c5f7155cc8c2"} Sep 11 20:46:27.635045 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.634959 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvh85" event={"ID":"403c152a-7714-4132-9b87-4364739ee54a","Type":"ContainerStarted","Data":"ed5adca3ce7bfcc93927f9fcb06c0ffb7cc7d22d56252ad934a39a67600e1d02"} Sep 11 20:46:27.651161 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.651123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerStarted","Data":"d6d75ded6fa81b921aa444f017b01b2b13b04c213014a1b0d42e1015c703ae79"} Sep 11 20:46:27.655121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.654819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" event={"ID":"858e19b602c8b52b1cec4fc039dfc853","Type":"ContainerStarted","Data":"0e5e68509bd1847d6f43c80209b700baed59fb7f0cc812ae489d81d3437743e1"} Sep 11 20:46:27.665560 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.665534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" event={"ID":"dad58467d753112c5733ab02ffa92d87","Type":"ContainerStarted","Data":"7eaae9fa9841893f08ecfa1977737562b06d1f32802bd02232d1c75c2a1d0c2e"} Sep 11 20:46:27.705287 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:27.705258 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:28.148217 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.148180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:28.148542 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.148257 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:28.148542 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.148359 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:28.148542 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.148395 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:28.148542 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.148434 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:30.148413981 +0000 UTC m=+5.081812997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:28.148542 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.148455 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:46:30.148445158 +0000 UTC m=+5.081844162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:28.249331 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.248575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:28.249331 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.248801 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:28.249331 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.248822 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:28.249331 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.248835 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:28.249331 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.248892 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:30.248874468 +0000 UTC m=+5.182273479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:28.474257 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.474120 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 20:41:26 +0000 UTC" deadline="2028-05-02 02:33:44.317858793 +0000 UTC" Sep 11 20:46:28.474257 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.474180 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14357h47m15.843682705s" Sep 11 20:46:28.522034 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.521143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:28.522034 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.521334 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:28.522034 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.521448 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:28.522034 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.521580 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:28.522034 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:28.521633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:28.522034 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:28.521703 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:29.476778 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:29.476743 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 20:46:30.165894 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:30.165857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:30.166101 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:30.165917 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:30.166101 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.166034 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:30.166101 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.166056 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:30.166101 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.166100 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:46:34.166087711 +0000 UTC m=+9.099486728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:30.166339 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.166114 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:34.166107827 +0000 UTC m=+9.099506832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:30.266546 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:30.266507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:30.266791 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.266727 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:30.266791 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.266754 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:30.266791 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.266767 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:30.266989 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.266825 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:34.266805454 +0000 UTC m=+9.200204473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:30.521702 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:30.520980 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:30.521702 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.521106 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:30.521702 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:30.521504 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:30.521702 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.521617 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:30.521702 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:30.521671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:30.522451 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:30.521748 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:32.521214 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:32.521182 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:32.521697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:32.521218 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:32.521697 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:32.521620 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:32.521816 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:32.521777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:32.522514 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:32.521943 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:32.522514 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:32.522095 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:34.201569 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:34.201218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:34.201569 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:34.201294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:34.201569 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.201444 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:34.201569 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.201512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:46:42.201494593 +0000 UTC m=+17.134893618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:34.201569 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.201513 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:34.201569 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.201547 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:42.201537789 +0000 UTC m=+17.134936796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:34.302125 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:34.302085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:34.302303 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.302240 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:34.302303 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.302259 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:34.302303 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.302272 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:34.302459 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.302350 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:42.302332232 +0000 UTC m=+17.235731248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:34.520625 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:34.520490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:34.520625 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.520614 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:34.521116 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:34.520861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:34.521116 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:34.520485 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:34.521116 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.520996 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:34.521116 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:34.521077 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:36.521154 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:36.521115 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:36.521592 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:36.521124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:36.521592 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:36.521224 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:36.521592 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:36.521123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:36.521592 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:36.521329 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:36.521592 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:36.521417 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:38.521137 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:38.521096 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:38.521656 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:38.521105 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:38.521656 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:38.521119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:38.521656 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:38.521348 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:38.521656 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:38.521224 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:38.521656 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:38.521456 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:40.521465 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:40.521427 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:40.521465 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:40.521469 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:40.521988 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:40.521432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:40.521988 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:40.521548 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:40.521988 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:40.521669 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:40.521988 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:40.521718 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:42.259327 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:42.259270 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:42.259808 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:42.259375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:42.259808 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.259450 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:42.259808 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.259489 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:42.259808 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.259536 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:46:58.259513775 +0000 UTC m=+33.192912782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:42.259808 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.259556 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:58.259546083 +0000 UTC m=+33.192945094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:42.360718 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:42.360677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:42.360890 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.360842 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:42.360890 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.360864 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:42.360890 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.360874 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:42.361027 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.360931 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:46:58.360917766 +0000 UTC m=+33.294316775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:42.521426 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:42.521295 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:42.521426 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:42.521328 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:42.521426 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:42.521328 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:42.521773 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.521450 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:42.521773 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.521577 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:42.521773 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:42.521663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:44.520491 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:44.520447 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:44.520491 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:44.520470 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:44.520491 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:44.520484 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:44.520998 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:44.520602 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:44.520998 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:44.520714 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:44.520998 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:44.520792 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:45.710926 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:45.710679 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" event={"ID":"dad58467d753112c5733ab02ffa92d87","Type":"ContainerStarted","Data":"749647aa9a3c24c516e8c2f29abcacbe6a669455c1742cbcc268d1a118cb1260"} Sep 11 20:46:45.713846 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:45.713731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"6a9ca20405a27b8f42d0b44d2b79225ff2fbe9880ca13ab180bf6b6bfd4f636f"} Sep 11 20:46:45.720383 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:45.720359 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmtr2" event={"ID":"8c456dbc-99f2-4a81-a556-fbf0bbbed523","Type":"ContainerStarted","Data":"8940c1e27d362f9950295cf205a26fd4c66741080cae035fc2255e530c4fb042"} Sep 11 20:46:45.726495 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:45.726417 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-21.ec2.internal" podStartSLOduration=19.726396656 podStartE2EDuration="19.726396656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:45.725900927 +0000 UTC m=+20.659299956" watchObservedRunningTime="2026-09-11 20:46:45.726396656 +0000 UTC m=+20.659795684" Sep 11 20:46:45.729811 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:45.729437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pct25" event={"ID":"eceef04f-754d-4de0-aada-8331db96c92a","Type":"ContainerStarted","Data":"68c218bd9d175166ec006519bd51061327d5ee0b5d8927867615735cf7629a94"} Sep 11 20:46:45.742676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:45.742630 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cmtr2" podStartSLOduration=2.242569646 podStartE2EDuration="20.742614597s" totalImagesPullingTime="18.500044951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:45.741969118 +0000 UTC m=+20.675368146" watchObservedRunningTime="2026-09-11 20:46:45.742614597 +0000 UTC m=+20.676013636" Sep 11 20:46:46.521082 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.520848 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:46.521236 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.520900 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:46.521236 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:46.521115 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:46.521236 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.520904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:46.521370 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:46.521189 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:46.521370 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:46.521276 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:46.732619 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.732584 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hg6vw" event={"ID":"1322470e-4e4c-4618-9fd0-be94e6fe37c1","Type":"ContainerStarted","Data":"5f5d7aa73d4c4ea7f1f80a17af2e04a31166e8f12cbd6da02678e6ce689638a6"} Sep 11 20:46:46.736089 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.736063 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"9b0cddf3c651afe1250329b79237a91c0f400e089ae9f8127dfb6c0e8cd4e4f0"} Sep 11 20:46:46.736232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.736147 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"9a01a8697f0f4d70be1f42d039e9d7243514a79d02f456a2b2c190e7ee0975fb"} Sep 11 20:46:46.736232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.736199 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"85a8e6cb83d145f49fc50f96266ccd5bd8ddff637a5b03644d0d1d7855096a32"} Sep 11 20:46:46.736332 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.736246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"4b780ee2158ce9e9767e7abe00c8edc1840425c474945f84954019a5afc1876f"} Sep 11 20:46:46.736332 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.736293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"5a8f588624c25320d9e2ef812967d887c5bcc13b9d8ccb0910cae242ed4e2190"} Sep 11 20:46:46.737574 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.737552 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gffmh" event={"ID":"63f266a3-8f0d-40b0-8794-38257bf5965c","Type":"ContainerStarted","Data":"afdd9a3f1a9dbd9cdfb3c10aa77ec3620d967f1bf92f3fa18b913baf256aabf3"} Sep 11 20:46:46.739132 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.739108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" event={"ID":"3a736981-daee-47f0-a35c-2d3979edac8b","Type":"ContainerStarted","Data":"17a7f787bccd121f137c4438fab5cf6aa557c1e3e43a2283b17fce99074e9175"} Sep 11 20:46:46.740699 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.740676 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47xhm" event={"ID":"8692ca9c-f056-40d5-b15e-c0ea8b69627f","Type":"ContainerStarted","Data":"72a34d24852fac97a927fe0f45c3ab6d36c2a1897847410d046289d308c7357d"} Sep 11 20:46:46.742469 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.742437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvh85" event={"ID":"403c152a-7714-4132-9b87-4364739ee54a","Type":"ContainerStarted","Data":"4822034967e95c5473bf7cb73ea3050beeea8b0e3f9ee5ae86def76dcdcb69aa"} Sep 11 20:46:46.743895 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.743871 2560 generic.go:356] "Generic (PLEG): container finished" podID="dba4cda1-287c-4eba-8316-0fa1100249ba" containerID="63358e621bf100f8a21d9068706bd1a7876cbd3ee9081dff6554d13399fae1ff" exitCode=0 Sep 11 20:46:46.743991 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.743899 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerDied","Data":"63358e621bf100f8a21d9068706bd1a7876cbd3ee9081dff6554d13399fae1ff"} Sep 11 20:46:46.745663 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.745640 2560 generic.go:356] "Generic (PLEG): container finished" podID="858e19b602c8b52b1cec4fc039dfc853" containerID="d188924cd12a94b862bae15c6b154875c6f2dde15b29437ee2562482d1f26270" exitCode=0 Sep 11 20:46:46.745805 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.745669 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pct25" podStartSLOduration=3.473320977 podStartE2EDuration="21.745654424s" totalImagesPullingTime="18.272333447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:45.764185048 +0000 UTC m=+20.697584074" watchObservedRunningTime="2026-09-11 20:46:46.745654424 +0000 UTC m=+21.679053452" Sep 11 20:46:46.745805 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.745729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" event={"ID":"858e19b602c8b52b1cec4fc039dfc853","Type":"ContainerDied","Data":"d188924cd12a94b862bae15c6b154875c6f2dde15b29437ee2562482d1f26270"} Sep 11 20:46:46.763497 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.763443 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hg6vw" podStartSLOduration=3.551049313 podStartE2EDuration="21.763424617s" totalImagesPullingTime="18.212375304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:46.745381117 +0000 UTC m=+21.678780144" watchObservedRunningTime="2026-09-11 20:46:46.763424617 +0000 UTC m=+21.696823644" Sep 11 20:46:46.776388 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.776285 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gvh85" podStartSLOduration=3.466727673 podStartE2EDuration="21.776269695s" totalImagesPullingTime="18.309542022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:46.776210805 +0000 UTC m=+21.709609831" watchObservedRunningTime="2026-09-11 20:46:46.776269695 +0000 UTC m=+21.709668722" Sep 11 20:46:46.788913 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.788817 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-47xhm" podStartSLOduration=3.4949990189999998 podStartE2EDuration="21.788793658s" totalImagesPullingTime="18.293794639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:46.788747289 +0000 UTC m=+21.722146315" watchObservedRunningTime="2026-09-11 20:46:46.788793658 +0000 UTC m=+21.722192685" Sep 11 20:46:46.802586 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:46.802527 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gffmh" podStartSLOduration=3.545560463 podStartE2EDuration="21.80250443s" totalImagesPullingTime="18.256943967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:46.801944903 +0000 UTC m=+21.735343932" watchObservedRunningTime="2026-09-11 20:46:46.80250443 +0000 UTC m=+21.735903458" Sep 11 20:46:47.333180 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.333163 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 20:46:47.603768 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.603668 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T20:46:47.33317929Z","UUID":"8b752038-76a9-4f9f-9c9e-3537a6792902","Handler":null,"Name":"","Endpoint":""} Sep 11 20:46:47.605436 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.605416 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 20:46:47.605555 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.605445 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 20:46:47.750246 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.750207 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" event={"ID":"3a736981-daee-47f0-a35c-2d3979edac8b","Type":"ContainerStarted","Data":"393bd2baea1aa5186db622a517d2885a37ba53dd48923f01a97de372d3bf6f93"} Sep 11 20:46:47.752476 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.752443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" event={"ID":"858e19b602c8b52b1cec4fc039dfc853","Type":"ContainerStarted","Data":"8f032c969ed184d8152576b3e8daea31809ed8edf6d8c22055ab96eebfe1b769"} Sep 11 20:46:47.767869 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:47.767818 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-21.ec2.internal" podStartSLOduration=21.767802695 podStartE2EDuration="21.767802695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:47.767602197 +0000 UTC m=+22.701001226" watchObservedRunningTime="2026-09-11 20:46:47.767802695 +0000 UTC m=+22.701201721" Sep 11 20:46:48.521061 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:48.521032 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:48.521251 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:48.521153 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:48.521340 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:48.521264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:48.521436 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:48.521415 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:48.521489 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:48.521451 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:48.521544 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:48.521527 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:48.757454 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:48.757423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"b68073fca8bb02d059722b18b2dbb47a48df088a9b5f11288a4bae4bdf2d3219"} Sep 11 20:46:49.693117 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.693073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:49.762681 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.762636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" event={"ID":"3a736981-daee-47f0-a35c-2d3979edac8b","Type":"ContainerStarted","Data":"128fe3aaafa0361ece775ce5b5a1dd751f871e88b3ad92643e20ee1a25257ebc"} Sep 11 20:46:49.783183 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.783135 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt69q" podStartSLOduration=3.868450132 podStartE2EDuration="24.783119235s" totalImagesPullingTime="20.914669103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:49.782700854 +0000 UTC m=+24.716099893" watchObservedRunningTime="2026-09-11 20:46:49.783119235 +0000 UTC m=+24.716518262" Sep 11 20:46:49.786933 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.786907 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:49.847568 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.847533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:49.901729 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.901699 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:49.902360 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:49.902337 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:50.520995 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.520955 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:50.521166 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.520955 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:50.521166 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:50.521093 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:50.521166 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.520956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:50.521166 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:50.521160 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:50.521408 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:50.521225 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:50.765934 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.765884 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:50.766439 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.766207 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-47xhm" Sep 11 20:46:50.825225 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.825196 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:50.924923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:50.924888 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:51.772196 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:51.772162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" event={"ID":"6705b5d7-c96e-49ac-a820-817edde97ca2","Type":"ContainerStarted","Data":"f2b8433ef8a2fe00eaf4a4c0018d53626a1e95bfa4718703fd1ea772a11650ef"} Sep 11 20:46:51.802620 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:51.802437 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" podStartSLOduration=8.101432304 podStartE2EDuration="26.802418529s" totalImagesPullingTime="18.700986225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:46:51.796012112 +0000 UTC m=+26.729411153" watchObservedRunningTime="2026-09-11 20:46:51.802418529 +0000 UTC m=+26.735817595" Sep 11 20:46:52.521023 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.520989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:52.521023 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.521019 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:52.521237 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.521029 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:52.521237 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:52.521140 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:52.521381 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:52.521238 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:52.521381 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:52.521299 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:52.776372 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.776287 2560 generic.go:356] "Generic (PLEG): container finished" podID="dba4cda1-287c-4eba-8316-0fa1100249ba" containerID="87ede3e7449ef1f3ca685aea81a8d729016a4db4d1d98e72e682d76b8d6fee1a" exitCode=0 Sep 11 20:46:52.776705 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.776370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerDied","Data":"87ede3e7449ef1f3ca685aea81a8d729016a4db4d1d98e72e682d76b8d6fee1a"} Sep 11 20:46:52.776831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.776815 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:52.776901 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.776884 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:52.776949 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.776938 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:52.793762 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.793738 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:52.793886 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:52.793874 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:46:53.357309 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.357275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:53.460950 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.460915 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:53.616051 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.615969 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xzslg"] Sep 11 20:46:53.616203 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.616088 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:53.616203 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:53.616192 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:53.619117 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.619083 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hsn6q"] Sep 11 20:46:53.619231 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.619196 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:53.619326 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:53.619295 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:53.619757 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.619724 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xccmr"] Sep 11 20:46:53.619861 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:53.619818 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:53.619937 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:53.619902 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:54.782509 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:54.782328 2560 generic.go:356] "Generic (PLEG): container finished" podID="dba4cda1-287c-4eba-8316-0fa1100249ba" containerID="b73466ddefd17e0d71cbb7bf5767f0b1d7af0f7e2e41ee3585e02cbd1ea4b358" exitCode=0 Sep 11 20:46:54.783258 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:54.782405 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerDied","Data":"b73466ddefd17e0d71cbb7bf5767f0b1d7af0f7e2e41ee3585e02cbd1ea4b358"} Sep 11 20:46:55.521195 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:55.521160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:55.521395 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:55.521251 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:55.521395 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:55.521261 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:55.521395 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:55.521278 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:55.521395 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:55.521365 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:55.521605 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:55.521431 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:56.791745 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:56.791705 2560 generic.go:356] "Generic (PLEG): container finished" podID="dba4cda1-287c-4eba-8316-0fa1100249ba" containerID="a78960890e02ad5e219d522193c571e779262708223891047376e51530f4d631" exitCode=0 Sep 11 20:46:56.792141 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:56.791767 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerDied","Data":"a78960890e02ad5e219d522193c571e779262708223891047376e51530f4d631"} Sep 11 20:46:57.520992 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:57.520903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:57.520992 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:57.520901 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:57.521237 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:57.521042 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xzslg" podUID="e02b51b0-219a-43d0-b1a6-d899d810b803" Sep 11 20:46:57.521237 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:57.521055 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:57.521237 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:57.521169 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccmr" podUID="15719e0e-2c1e-4a6a-86f8-d9d9e3952714" Sep 11 20:46:57.521390 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:57.521277 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn6q" podUID="37c7e377-0b57-4cb3-9573-f3e36e1f7aba" Sep 11 20:46:58.275305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:58.275265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:58.275822 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:58.275340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:58.275822 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.275422 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:58.275822 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.275438 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:58.275822 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.275495 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret podName:37c7e377-0b57-4cb3-9573-f3e36e1f7aba nodeName:}" failed. No retries permitted until 2026-09-11 20:47:30.275480716 +0000 UTC m=+65.208879737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret") pod "global-pull-secret-syncer-hsn6q" (UID: "37c7e377-0b57-4cb3-9573-f3e36e1f7aba") : object "kube-system"/"original-pull-secret" not registered Sep 11 20:46:58.275822 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.275512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs podName:e02b51b0-219a-43d0-b1a6-d899d810b803 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:30.275505158 +0000 UTC m=+65.208904167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs") pod "network-metrics-daemon-xzslg" (UID: "e02b51b0-219a-43d0-b1a6-d899d810b803") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 20:46:58.375975 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:58.375933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:58.376157 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.376109 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 20:46:58.376157 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.376138 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 20:46:58.376157 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.376152 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2zqr2 for pod openshift-network-diagnostics/network-check-target-xccmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:58.376279 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:58.376208 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2 podName:15719e0e-2c1e-4a6a-86f8-d9d9e3952714 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:30.376194838 +0000 UTC m=+65.309593856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zqr2" (UniqueName: "kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2") pod "network-check-target-xccmr" (UID: "15719e0e-2c1e-4a6a-86f8-d9d9e3952714") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 20:46:59.403614 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.403589 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-21.ec2.internal" event="NodeReady" Sep 11 20:46:59.403987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.403715 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 20:46:59.448547 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.448449 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nsrxk"] Sep 11 20:46:59.469176 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.469144 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ztqch"] Sep 11 20:46:59.469349 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.469281 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.471891 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.471869 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 20:46:59.472021 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.471948 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 20:46:59.472167 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.472144 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj9r9\"" Sep 11 20:46:59.485373 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.485354 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nsrxk"] Sep 11 20:46:59.485473 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.485395 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ztqch"] Sep 11 20:46:59.485538 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.485490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.487707 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.487686 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 20:46:59.487799 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.487704 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8lpqx\"" Sep 11 20:46:59.487799 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.487712 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 20:46:59.487799 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.487749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 20:46:59.520806 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.520779 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:46:59.520806 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.520796 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:46:59.521487 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.521038 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:46:59.523511 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.523236 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p8x26\"" Sep 11 20:46:59.523511 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.523262 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 20:46:59.523511 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.523329 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 20:46:59.523511 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.523347 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn5l2\"" Sep 11 20:46:59.523750 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.523611 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 20:46:59.523750 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.523619 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 20:46:59.586160 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.586123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmkqj\" (UniqueName: \"kubernetes.io/projected/93db5312-27cf-47ea-82c1-342181fc8d13-kube-api-access-jmkqj\") pod \"ingress-canary-ztqch\" (UID: \"93db5312-27cf-47ea-82c1-342181fc8d13\") " pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.586302 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.586164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab08e004-54f6-4959-aedf-06726e466290-config-volume\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.586302 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.586259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab08e004-54f6-4959-aedf-06726e466290-tmp-dir\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.586428 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.586309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4sx\" (UniqueName: \"kubernetes.io/projected/ab08e004-54f6-4959-aedf-06726e466290-kube-api-access-hm4sx\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.586428 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.586390 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.586521 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.586429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93db5312-27cf-47ea-82c1-342181fc8d13-cert\") pod \"ingress-canary-ztqch\" (UID: \"93db5312-27cf-47ea-82c1-342181fc8d13\") " pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.662017 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.661937 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:59.687525 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmkqj\" (UniqueName: \"kubernetes.io/projected/93db5312-27cf-47ea-82c1-342181fc8d13-kube-api-access-jmkqj\") pod \"ingress-canary-ztqch\" (UID: \"93db5312-27cf-47ea-82c1-342181fc8d13\") " pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.687689 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab08e004-54f6-4959-aedf-06726e466290-config-volume\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.687689 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab08e004-54f6-4959-aedf-06726e466290-tmp-dir\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.687807 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4sx\" (UniqueName: \"kubernetes.io/projected/ab08e004-54f6-4959-aedf-06726e466290-kube-api-access-hm4sx\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.687807 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.687950 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93db5312-27cf-47ea-82c1-342181fc8d13-cert\") pod \"ingress-canary-ztqch\" (UID: \"93db5312-27cf-47ea-82c1-342181fc8d13\") " pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.687950 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.687902 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab08e004-54f6-4959-aedf-06726e466290-tmp-dir\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.687950 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:59.687935 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 20:46:59.688119 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:46:59.687998 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls podName:ab08e004-54f6-4959-aedf-06726e466290 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:00.187979345 +0000 UTC m=+35.121378356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls") pod "dns-default-nsrxk" (UID: "ab08e004-54f6-4959-aedf-06726e466290") : secret "dns-default-metrics-tls" not found Sep 11 20:46:59.688188 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.688165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab08e004-54f6-4959-aedf-06726e466290-config-volume\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.692078 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.692058 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93db5312-27cf-47ea-82c1-342181fc8d13-cert\") pod \"ingress-canary-ztqch\" (UID: \"93db5312-27cf-47ea-82c1-342181fc8d13\") " pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.698760 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.698734 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4sx\" (UniqueName: \"kubernetes.io/projected/ab08e004-54f6-4959-aedf-06726e466290-kube-api-access-hm4sx\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:46:59.699309 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.699285 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmkqj\" (UniqueName: \"kubernetes.io/projected/93db5312-27cf-47ea-82c1-342181fc8d13-kube-api-access-jmkqj\") pod \"ingress-canary-ztqch\" (UID: \"93db5312-27cf-47ea-82c1-342181fc8d13\") " pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:46:59.762220 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.762186 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:46:59.796171 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:46:59.796137 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ztqch" Sep 11 20:47:00.190669 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:00.190632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:00.190831 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:00.190714 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 20:47:00.190831 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:00.190789 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls podName:ab08e004-54f6-4959-aedf-06726e466290 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:01.190771111 +0000 UTC m=+36.124170131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls") pod "dns-default-nsrxk" (UID: "ab08e004-54f6-4959-aedf-06726e466290") : secret "dns-default-metrics-tls" not found Sep 11 20:47:00.897285 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:00.897255 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:01.197871 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.197654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:01.197871 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:01.197832 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 20:47:01.198087 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:01.197912 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls podName:ab08e004-54f6-4959-aedf-06726e466290 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:03.197890619 +0000 UTC m=+38.131289637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls") pod "dns-default-nsrxk" (UID: "ab08e004-54f6-4959-aedf-06726e466290") : secret "dns-default-metrics-tls" not found Sep 11 20:47:01.250369 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.250345 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ztqch"] Sep 11 20:47:01.255831 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:01.255647 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93db5312_27cf_47ea_82c1_342181fc8d13.slice/crio-73c7281f974df57fda32e28399b1053378a3373c511549d090cba75b8ca1ba95 WatchSource:0}: Error finding container 73c7281f974df57fda32e28399b1053378a3373c511549d090cba75b8ca1ba95: Status 404 returned error can't find the container with id 73c7281f974df57fda32e28399b1053378a3373c511549d090cba75b8ca1ba95 Sep 11 20:47:01.584137 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.584110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:01.767993 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.767960 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn"] Sep 11 20:47:01.773705 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.773676 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" Sep 11 20:47:01.777137 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.777113 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 11 20:47:01.777272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.777112 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 11 20:47:01.777345 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.777123 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jhhth\"" Sep 11 20:47:01.778437 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.778408 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:01.783653 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.783629 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn"] Sep 11 20:47:01.808127 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.808030 2560 generic.go:356] "Generic (PLEG): container finished" podID="dba4cda1-287c-4eba-8316-0fa1100249ba" containerID="fd46b446fb65852ef3ab6cd85eeddc3299779060e35478141c2d258b5762aab3" exitCode=0 Sep 11 20:47:01.808127 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.808077 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerDied","Data":"fd46b446fb65852ef3ab6cd85eeddc3299779060e35478141c2d258b5762aab3"} Sep 11 20:47:01.810033 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.809989 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ztqch" event={"ID":"93db5312-27cf-47ea-82c1-342181fc8d13","Type":"ContainerStarted","Data":"73c7281f974df57fda32e28399b1053378a3373c511549d090cba75b8ca1ba95"} Sep 11 20:47:01.854302 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.854249 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6fj96"] Sep 11 20:47:01.858491 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.858446 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:01.874311 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.874199 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6fj96"] Sep 11 20:47:01.874311 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.874280 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:01.877000 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.876977 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d4bx9\"" Sep 11 20:47:01.877127 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.877098 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 20:47:01.877270 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.877205 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 20:47:01.877270 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.877231 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 20:47:01.877270 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.877202 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 20:47:01.903060 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:01.903037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrbx\" (UniqueName: \"kubernetes.io/projected/63d92b7a-4485-4af6-b36b-89eefbe48c4c-kube-api-access-wqrbx\") pod \"migrator-8b4d697c5-xnhsn\" (UID: \"63d92b7a-4485-4af6-b36b-89eefbe48c4c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" Sep 11 20:47:02.003637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.003603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.003802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.003647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrbx\" (UniqueName: \"kubernetes.io/projected/63d92b7a-4485-4af6-b36b-89eefbe48c4c-kube-api-access-wqrbx\") pod \"migrator-8b4d697c5-xnhsn\" (UID: \"63d92b7a-4485-4af6-b36b-89eefbe48c4c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" Sep 11 20:47:02.003802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.003667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-crio-socket\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.003802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.003687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-data-volume\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.003802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.003747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75jc\" (UniqueName: \"kubernetes.io/projected/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-api-access-c75jc\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.004003 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.003826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.012335 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.012289 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrbx\" (UniqueName: \"kubernetes.io/projected/63d92b7a-4485-4af6-b36b-89eefbe48c4c-kube-api-access-wqrbx\") pod \"migrator-8b4d697c5-xnhsn\" (UID: \"63d92b7a-4485-4af6-b36b-89eefbe48c4c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" Sep 11 20:47:02.085247 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.085211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" Sep 11 20:47:02.104209 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.104174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.104362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.104234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-crio-socket\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.104362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.104264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-data-volume\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.104362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.104292 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75jc\" (UniqueName: \"kubernetes.io/projected/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-api-access-c75jc\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.104490 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.104361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.104490 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.104467 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 20:47:02.104552 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.104529 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:02.604514205 +0000 UTC m=+37.537913209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : configmap "kube-rbac-proxy" not found Sep 11 20:47:02.105035 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.105017 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 20:47:02.105097 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.105077 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:02.605060111 +0000 UTC m=+37.538459130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : secret "insights-runtime-extractor-tls" not found Sep 11 20:47:02.105183 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.105120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-data-volume\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.105307 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.105280 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-crio-socket\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.116982 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.116952 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75jc\" (UniqueName: \"kubernetes.io/projected/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-api-access-c75jc\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.286950 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.286899 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:02.342561 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.342515 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:02.371594 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.371519 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn"] Sep 11 20:47:02.375634 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:02.375608 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d92b7a_4485_4af6_b36b_89eefbe48c4c.slice/crio-cd977de8c022665f38618ab057198e3b4e67a5c23a423539e5324caf0991b915 WatchSource:0}: Error finding container cd977de8c022665f38618ab057198e3b4e67a5c23a423539e5324caf0991b915: Status 404 returned error can't find the container with id cd977de8c022665f38618ab057198e3b4e67a5c23a423539e5324caf0991b915 Sep 11 20:47:02.607912 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.607870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.608084 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.608039 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 20:47:02.608140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.608086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:02.608140 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.608126 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:03.608107105 +0000 UTC m=+38.541506144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : secret "insights-runtime-extractor-tls" not found Sep 11 20:47:02.608228 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.608218 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 20:47:02.608294 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:02.608284 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:03.608271576 +0000 UTC m=+38.541670604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : configmap "kube-rbac-proxy" not found Sep 11 20:47:02.813816 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.813578 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" event={"ID":"63d92b7a-4485-4af6-b36b-89eefbe48c4c","Type":"ContainerStarted","Data":"cd977de8c022665f38618ab057198e3b4e67a5c23a423539e5324caf0991b915"} Sep 11 20:47:02.816573 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.816548 2560 generic.go:356] "Generic (PLEG): container finished" podID="dba4cda1-287c-4eba-8316-0fa1100249ba" containerID="2267a7bd3bb8964f7df7e174e03bee85d6e3112aeb11b27ef62ec230234e037d" exitCode=0 Sep 11 20:47:02.816689 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.816585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerDied","Data":"2267a7bd3bb8964f7df7e174e03bee85d6e3112aeb11b27ef62ec230234e037d"} Sep 11 20:47:02.891559 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.891522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:02.950805 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:02.950761 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:03.213229 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.213194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:03.213418 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:03.213385 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 20:47:03.213479 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:03.213468 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls podName:ab08e004-54f6-4959-aedf-06726e466290 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:07.213444338 +0000 UTC m=+42.146843347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls") pod "dns-default-nsrxk" (UID: "ab08e004-54f6-4959-aedf-06726e466290") : secret "dns-default-metrics-tls" not found Sep 11 20:47:03.616601 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.616575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:03.616731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.616632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:03.616731 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:03.616700 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 20:47:03.616845 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:03.616739 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 20:47:03.616845 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:03.616750 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:05.616737254 +0000 UTC m=+40.550136259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : configmap "kube-rbac-proxy" not found Sep 11 20:47:03.616845 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:03.616819 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:05.616797203 +0000 UTC m=+40.550196220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : secret "insights-runtime-extractor-tls" not found Sep 11 20:47:03.641640 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.641617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:03.742496 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.742447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:03.823298 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.823268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" event={"ID":"dba4cda1-287c-4eba-8316-0fa1100249ba","Type":"ContainerStarted","Data":"67063b6c6053d3d59af9d1ed6bb76eb6a25faeaea69e2467e8ab08c25b26b40f"} Sep 11 20:47:03.844241 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.844197 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxc9v" podStartSLOduration=9.023779532 podStartE2EDuration="38.844182864s" totalImagesPullingTime="29.820403332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:03.843242584 +0000 UTC m=+38.776641611" watchObservedRunningTime="2026-09-11 20:47:03.844182864 +0000 UTC m=+38.777581882" Sep 11 20:47:03.892904 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.891138 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9f7bt"] Sep 11 20:47:03.905111 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.905087 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9f7bt"] Sep 11 20:47:03.905311 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.905190 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:03.907549 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.907526 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 11 20:47:03.907655 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.907583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hjbd4\"" Sep 11 20:47:03.907655 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.907643 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 11 20:47:03.907756 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.907583 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 11 20:47:03.907928 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.907912 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 11 20:47:03.946041 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:03.945859 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:04.020153 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.020030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjdhn\" (UniqueName: \"kubernetes.io/projected/e879f126-d9a0-4596-9c67-18a0a68df7ca-kube-api-access-mjdhn\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.020153 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.020080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e879f126-d9a0-4596-9c67-18a0a68df7ca-signing-cabundle\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.020650 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.020214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e879f126-d9a0-4596-9c67-18a0a68df7ca-signing-key\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.092374 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.092333 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:04.121376 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.121347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e879f126-d9a0-4596-9c67-18a0a68df7ca-signing-key\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.121529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.121412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjdhn\" (UniqueName: \"kubernetes.io/projected/e879f126-d9a0-4596-9c67-18a0a68df7ca-kube-api-access-mjdhn\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.121529 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.121445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e879f126-d9a0-4596-9c67-18a0a68df7ca-signing-cabundle\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.122217 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.122193 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e879f126-d9a0-4596-9c67-18a0a68df7ca-signing-cabundle\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.124731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.124709 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e879f126-d9a0-4596-9c67-18a0a68df7ca-signing-key\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.129916 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.129897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjdhn\" (UniqueName: \"kubernetes.io/projected/e879f126-d9a0-4596-9c67-18a0a68df7ca-kube-api-access-mjdhn\") pod \"service-ca-568869fdc5-9f7bt\" (UID: \"e879f126-d9a0-4596-9c67-18a0a68df7ca\") " pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.157674 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.157651 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:04.214925 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.214888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" Sep 11 20:47:04.234535 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.234508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:04.288193 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.288167 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:04.416581 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.416511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hg6vw_1322470e-4e4c-4618-9fd0-be94e6fe37c1/dns-node-resolver/0.log" Sep 11 20:47:04.501074 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.501043 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9f7bt"] Sep 11 20:47:04.631207 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:04.631178 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode879f126_d9a0_4596_9c67_18a0a68df7ca.slice/crio-5cc105e74f1cea12b570ab443636882d4568e6804874e80f98f66998357abb6d WatchSource:0}: Error finding container 5cc105e74f1cea12b570ab443636882d4568e6804874e80f98f66998357abb6d: Status 404 returned error can't find the container with id 5cc105e74f1cea12b570ab443636882d4568e6804874e80f98f66998357abb6d Sep 11 20:47:04.826367 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.826341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" event={"ID":"e879f126-d9a0-4596-9c67-18a0a68df7ca","Type":"ContainerStarted","Data":"5cc105e74f1cea12b570ab443636882d4568e6804874e80f98f66998357abb6d"} Sep 11 20:47:04.827720 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.827692 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ztqch" event={"ID":"93db5312-27cf-47ea-82c1-342181fc8d13","Type":"ContainerStarted","Data":"1b57c96200c6e70566efa313e3415abf3d617b2af59d24dd39b312e04ebba126"} Sep 11 20:47:04.844504 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:04.844459 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ztqch" podStartSLOduration=3.312496978 podStartE2EDuration="5.844443881s" totalImagesPullingTime="2.531946903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:04.843791078 +0000 UTC m=+39.777190107" watchObservedRunningTime="2026-09-11 20:47:04.844443881 +0000 UTC m=+39.777842907" Sep 11 20:47:05.020689 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.020660 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:05.120200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.120167 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:05.357205 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.357113 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:05.416873 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.416846 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gffmh_63f266a3-8f0d-40b0-8794-38257bf5965c/node-ca/0.log" Sep 11 20:47:05.631913 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.631839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:05.632079 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.631927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:05.632079 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:05.631997 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 20:47:05.632079 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:05.632075 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:09.632053241 +0000 UTC m=+44.565452258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : secret "insights-runtime-extractor-tls" not found Sep 11 20:47:05.632507 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.632490 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:05.832197 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.832163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" event={"ID":"63d92b7a-4485-4af6-b36b-89eefbe48c4c","Type":"ContainerStarted","Data":"bcd278c9ca99a367cc69a9eb498bb734eebb417d3fa9791f88139a75949c556b"} Sep 11 20:47:05.832423 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.832224 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" event={"ID":"63d92b7a-4485-4af6-b36b-89eefbe48c4c","Type":"ContainerStarted","Data":"dd57a682fbc0998abfa96ef03c51352cb2fc804ff0698a4e1e1b0a04f039c6d4"} Sep 11 20:47:05.854986 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:05.854900 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-xnhsn" podStartSLOduration=2.242361337 podStartE2EDuration="4.854878134s" totalImagesPullingTime="2.612516797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:05.85066576 +0000 UTC m=+40.784064802" watchObservedRunningTime="2026-09-11 20:47:05.854878134 +0000 UTC m=+40.788277165" Sep 11 20:47:06.615890 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:06.615863 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ztqch_93db5312-27cf-47ea-82c1-342181fc8d13/serve-healthcheck-canary/0.log" Sep 11 20:47:06.816453 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:06.816425 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-xnhsn_63d92b7a-4485-4af6-b36b-89eefbe48c4c/migrator/0.log" Sep 11 20:47:07.015398 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:07.015299 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-xnhsn_63d92b7a-4485-4af6-b36b-89eefbe48c4c/graceful-termination/0.log" Sep 11 20:47:07.246042 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:07.245986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:07.246211 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:07.246144 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 20:47:07.246249 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:07.246217 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls podName:ab08e004-54f6-4959-aedf-06726e466290 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:15.246199558 +0000 UTC m=+50.179598580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls") pod "dns-default-nsrxk" (UID: "ab08e004-54f6-4959-aedf-06726e466290") : secret "dns-default-metrics-tls" not found Sep 11 20:47:07.794336 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:07.794291 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:07.838749 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:07.838717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" event={"ID":"e879f126-d9a0-4596-9c67-18a0a68df7ca","Type":"ContainerStarted","Data":"747bac40e67102f5b666520ab8cab2400dd1219f09d891230f362b745967df15"} Sep 11 20:47:07.855067 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:07.855010 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-9f7bt" podStartSLOduration=2.455182496 podStartE2EDuration="4.85499224s" totalImagesPullingTime="2.399809744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:07.853948967 +0000 UTC m=+42.787347995" watchObservedRunningTime="2026-09-11 20:47:07.85499224 +0000 UTC m=+42.788391268" Sep 11 20:47:08.821236 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:08.821199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:08.953991 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:08.953956 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:09.055254 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:09.055198 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:09.165225 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:09.165192 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:09.385904 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:09.385869 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:09.488559 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:09.488484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:09.541032 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:09.541002 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:09.664640 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:09.664599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:09.664843 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:09.664734 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 20:47:09.664843 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:09.664801 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls podName:fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb nodeName:}" failed. No retries permitted until 2026-09-11 20:47:17.66478488 +0000 UTC m=+52.598183885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6fj96" (UID: "fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb") : secret "insights-runtime-extractor-tls" not found Sep 11 20:47:10.528784 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:10.528753 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:10.717554 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:10.717520 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:11.120920 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:11.120892 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:11.320536 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:11.320494 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:11.380400 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:11.380310 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:11.915054 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:11.915012 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:12.316572 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:12.316488 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:12.520237 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:12.520196 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:12.696444 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:12.696411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:12.801539 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:12.801493 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:13.119197 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:13.119133 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:13.520959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:13.520878 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:13.583383 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:13.583345 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:13.918506 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:13.918480 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:14.316499 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:14.316428 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:14.666329 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:14.666297 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:14.766846 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:14.766819 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:15.016644 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.016564 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:15.119222 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.119189 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:15.306533 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.306450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:15.308758 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.308724 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab08e004-54f6-4959-aedf-06726e466290-metrics-tls\") pod \"dns-default-nsrxk\" (UID: \"ab08e004-54f6-4959-aedf-06726e466290\") " pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:15.379819 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.379789 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:15.521170 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.521132 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:15.649038 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.649004 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nsrxk"] Sep 11 20:47:15.651773 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:15.651738 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab08e004_54f6_4959_aedf_06726e466290.slice/crio-3be4f14a0a383244bbd09cd01b209dffdf3894117736edcb15ff90a51e5b386d WatchSource:0}: Error finding container 3be4f14a0a383244bbd09cd01b209dffdf3894117736edcb15ff90a51e5b386d: Status 404 returned error can't find the container with id 3be4f14a0a383244bbd09cd01b209dffdf3894117736edcb15ff90a51e5b386d Sep 11 20:47:15.859500 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.859458 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsrxk" event={"ID":"ab08e004-54f6-4959-aedf-06726e466290","Type":"ContainerStarted","Data":"3be4f14a0a383244bbd09cd01b209dffdf3894117736edcb15ff90a51e5b386d"} Sep 11 20:47:15.920255 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:15.920178 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:16.118260 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:16.118229 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:16.512510 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:16.512467 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:17.118921 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.118885 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:17.518606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.518580 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:17.716828 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.716792 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:17.727798 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.727772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:17.729973 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.729955 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fj96\" (UID: \"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb\") " pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:17.797170 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.797063 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6fj96" Sep 11 20:47:17.867586 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.867551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsrxk" event={"ID":"ab08e004-54f6-4959-aedf-06726e466290","Type":"ContainerStarted","Data":"935a36870c0d1be9a4048d67ab4f91df12a9b8277f21002eaf18f6cfaa58ffd7"} Sep 11 20:47:17.867783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.867610 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsrxk" event={"ID":"ab08e004-54f6-4959-aedf-06726e466290","Type":"ContainerStarted","Data":"7ed49551755a5601b8bae6e77347b007d33f1e56c03902a09f4138d94b73dc37"} Sep 11 20:47:17.867783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.867692 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:17.885331 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:17.885270 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nsrxk" podStartSLOduration=17.027145823 podStartE2EDuration="18.885255443s" totalImagesPullingTime="1.85810962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:17.884553402 +0000 UTC m=+52.817952433" watchObservedRunningTime="2026-09-11 20:47:17.885255443 +0000 UTC m=+52.818654470" Sep 11 20:47:18.064940 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:18.064870 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6fj96"] Sep 11 20:47:18.068145 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:18.068113 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb82c8ba_2a2a_4f5a_8a7b_3d9568c11ddb.slice/crio-efe2363b67d74f84aa49dbe607ab4d4ea3c3a31912b150756ef632372d4ba525 WatchSource:0}: Error finding container efe2363b67d74f84aa49dbe607ab4d4ea3c3a31912b150756ef632372d4ba525: Status 404 returned error can't find the container with id efe2363b67d74f84aa49dbe607ab4d4ea3c3a31912b150756ef632372d4ba525 Sep 11 20:47:18.112270 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:18.112245 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:18.875237 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:18.875199 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fj96" event={"ID":"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb","Type":"ContainerStarted","Data":"a1e5597be4e86b0e9ab6a30de77bf238d03822f66eee25d40363c640b17bae5a"} Sep 11 20:47:18.875604 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:18.875262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fj96" event={"ID":"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb","Type":"ContainerStarted","Data":"558a0810fcbff11efa4085a990e27434dfb5c609a17afd5205c3ebe785890750"} Sep 11 20:47:18.875604 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:18.875292 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fj96" event={"ID":"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb","Type":"ContainerStarted","Data":"efe2363b67d74f84aa49dbe607ab4d4ea3c3a31912b150756ef632372d4ba525"} Sep 11 20:47:18.919291 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:18.919263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:19.115987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:19.115928 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:19.316551 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:19.316516 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:19.518643 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:19.518545 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:20.883036 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:20.883006 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fj96" event={"ID":"fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb","Type":"ContainerStarted","Data":"dffa6b6270c47ca342ea591d1d0551b4d6d1fe436cf5533a61115bf358052c4d"} Sep 11 20:47:20.900182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:20.900107 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6fj96" podStartSLOduration=17.676253328 podStartE2EDuration="19.900088642s" totalImagesPullingTime="2.223835314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:47:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:20.89999902 +0000 UTC m=+55.833398047" watchObservedRunningTime="2026-09-11 20:47:20.900088642 +0000 UTC m=+55.833487671" Sep 11 20:47:24.798915 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:24.798888 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p946" Sep 11 20:47:25.666462 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:25.666429 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:25.766981 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:25.766947 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:25.872331 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:25.872284 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:26.005498 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:26.005426 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:26.528711 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:26.528676 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:26.630036 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:26.630010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:26.683609 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:26.683576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:26.794254 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:26.794172 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:26.895059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:26.895026 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.008600 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.008559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.116844 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.116813 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.313889 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.313857 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t"] Sep 11 20:47:27.316468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.316444 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.319069 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.319046 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 20:47:27.319389 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.319360 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4rcvr\"" Sep 11 20:47:27.319389 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.319382 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 20:47:27.319548 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.319453 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 20:47:27.320238 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.320216 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 11 20:47:27.332298 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.332275 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t"] Sep 11 20:47:27.415958 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.415872 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-f4nht"] Sep 11 20:47:27.417821 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.417802 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2"] Sep 11 20:47:27.417940 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.417925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:27.418413 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.418387 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.419476 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.419461 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-545d45ff8-zzggt"] Sep 11 20:47:27.419580 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.419566 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:27.420282 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.420255 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 11 20:47:27.420282 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.420267 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 11 20:47:27.420441 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.420267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gk67j\"" Sep 11 20:47:27.421137 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.421120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.421683 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.421662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 11 20:47:27.421768 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.421753 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9smjl\"" Sep 11 20:47:27.423821 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.423802 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 20:47:27.423821 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.423808 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 20:47:27.424046 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.424013 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 20:47:27.424099 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.424046 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fmjp6\"" Sep 11 20:47:27.428767 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.428749 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 20:47:27.433612 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.433594 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-f4nht"] Sep 11 20:47:27.435793 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.435771 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-545d45ff8-zzggt"] Sep 11 20:47:27.448691 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.448671 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2"] Sep 11 20:47:27.495067 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.495037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a221ef3-550a-44fb-9851-6e8dc1ea163f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85d7bfc978-jk24t\" (UID: \"8a221ef3-550a-44fb-9851-6e8dc1ea163f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.495192 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.495071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhxz\" (UniqueName: \"kubernetes.io/projected/8a221ef3-550a-44fb-9851-6e8dc1ea163f-kube-api-access-2lhxz\") pod \"managed-serviceaccount-addon-agent-85d7bfc978-jk24t\" (UID: \"8a221ef3-550a-44fb-9851-6e8dc1ea163f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.509245 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.509217 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.595741 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95846d7c-4087-48a7-8669-0ed8fe317d27-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wsrw2\" (UID: \"95846d7c-4087-48a7-8669-0ed8fe317d27\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:27.595868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40419021-de22-4665-a40a-b9152ca10a7f-trusted-ca\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.595868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40419021-de22-4665-a40a-b9152ca10a7f-registry-certificates\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.595959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-bound-sa-token\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.595959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a221ef3-550a-44fb-9851-6e8dc1ea163f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85d7bfc978-jk24t\" (UID: \"8a221ef3-550a-44fb-9851-6e8dc1ea163f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.595959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdld\" (UniqueName: \"kubernetes.io/projected/8ccd1221-f95d-423e-8046-28a4208d64e7-kube-api-access-dgdld\") pod \"downloads-76f99584f4-f4nht\" (UID: \"8ccd1221-f95d-423e-8046-28a4208d64e7\") " pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:27.595959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40419021-de22-4665-a40a-b9152ca10a7f-image-registry-private-configuration\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.596091 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40419021-de22-4665-a40a-b9152ca10a7f-installation-pull-secrets\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.596091 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.595991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmlb\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-kube-api-access-dpmlb\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.596161 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.596105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-registry-tls\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.596161 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.596133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhxz\" (UniqueName: \"kubernetes.io/projected/8a221ef3-550a-44fb-9851-6e8dc1ea163f-kube-api-access-2lhxz\") pod \"managed-serviceaccount-addon-agent-85d7bfc978-jk24t\" (UID: \"8a221ef3-550a-44fb-9851-6e8dc1ea163f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.596161 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.596154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40419021-de22-4665-a40a-b9152ca10a7f-ca-trust-extracted\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.598614 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.598591 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a221ef3-550a-44fb-9851-6e8dc1ea163f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85d7bfc978-jk24t\" (UID: \"8a221ef3-550a-44fb-9851-6e8dc1ea163f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.606383 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.606360 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhxz\" (UniqueName: \"kubernetes.io/projected/8a221ef3-550a-44fb-9851-6e8dc1ea163f-kube-api-access-2lhxz\") pod \"managed-serviceaccount-addon-agent-85d7bfc978-jk24t\" (UID: \"8a221ef3-550a-44fb-9851-6e8dc1ea163f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.610567 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.610546 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.633627 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.633607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" Sep 11 20:47:27.696785 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40419021-de22-4665-a40a-b9152ca10a7f-trusted-ca\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.696907 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40419021-de22-4665-a40a-b9152ca10a7f-registry-certificates\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.696907 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-bound-sa-token\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.696907 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdld\" (UniqueName: \"kubernetes.io/projected/8ccd1221-f95d-423e-8046-28a4208d64e7-kube-api-access-dgdld\") pod \"downloads-76f99584f4-f4nht\" (UID: \"8ccd1221-f95d-423e-8046-28a4208d64e7\") " pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:27.696907 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40419021-de22-4665-a40a-b9152ca10a7f-image-registry-private-configuration\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.697094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40419021-de22-4665-a40a-b9152ca10a7f-installation-pull-secrets\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.697094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmlb\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-kube-api-access-dpmlb\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.697094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.696983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-registry-tls\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.697094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.697013 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40419021-de22-4665-a40a-b9152ca10a7f-ca-trust-extracted\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.697094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.697059 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95846d7c-4087-48a7-8669-0ed8fe317d27-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wsrw2\" (UID: \"95846d7c-4087-48a7-8669-0ed8fe317d27\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:27.698056 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.697791 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40419021-de22-4665-a40a-b9152ca10a7f-registry-certificates\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.698056 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.697909 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40419021-de22-4665-a40a-b9152ca10a7f-ca-trust-extracted\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.698056 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.698015 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40419021-de22-4665-a40a-b9152ca10a7f-trusted-ca\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.699694 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.699663 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40419021-de22-4665-a40a-b9152ca10a7f-installation-pull-secrets\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.699888 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.699867 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-registry-tls\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.700098 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.700066 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95846d7c-4087-48a7-8669-0ed8fe317d27-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wsrw2\" (UID: \"95846d7c-4087-48a7-8669-0ed8fe317d27\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:27.700408 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.700389 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40419021-de22-4665-a40a-b9152ca10a7f-image-registry-private-configuration\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.707930 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.707909 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-bound-sa-token\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.708435 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.708418 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdld\" (UniqueName: \"kubernetes.io/projected/8ccd1221-f95d-423e-8046-28a4208d64e7-kube-api-access-dgdld\") pod \"downloads-76f99584f4-f4nht\" (UID: \"8ccd1221-f95d-423e-8046-28a4208d64e7\") " pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:27.710494 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.710479 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmlb\" (UniqueName: \"kubernetes.io/projected/40419021-de22-4665-a40a-b9152ca10a7f-kube-api-access-dpmlb\") pod \"image-registry-545d45ff8-zzggt\" (UID: \"40419021-de22-4665-a40a-b9152ca10a7f\") " pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.728302 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.728279 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:27.733901 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.733881 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:27.738855 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.738828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:27.825770 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.825746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:27.877483 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.877451 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nsrxk" Sep 11 20:47:27.905904 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.905870 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t"] Sep 11 20:47:27.908738 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:27.908718 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a221ef3_550a_44fb_9851_6e8dc1ea163f.slice/crio-b80f5099eb0c18949244f22a63d49dc58d9e867d65cc3a3f260911da962ac611 WatchSource:0}: Error finding container b80f5099eb0c18949244f22a63d49dc58d9e867d65cc3a3f260911da962ac611: Status 404 returned error can't find the container with id b80f5099eb0c18949244f22a63d49dc58d9e867d65cc3a3f260911da962ac611 Sep 11 20:47:27.937974 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:27.937914 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.011192 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.011167 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-f4nht"] Sep 11 20:47:28.013418 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:28.013392 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ccd1221_f95d_423e_8046_28a4208d64e7.slice/crio-afbc8bc2da5cdbedeeeb9e39e0757fb99749d208a9ab08851dcb386e50b19c2e WatchSource:0}: Error finding container afbc8bc2da5cdbedeeeb9e39e0757fb99749d208a9ab08851dcb386e50b19c2e: Status 404 returned error can't find the container with id afbc8bc2da5cdbedeeeb9e39e0757fb99749d208a9ab08851dcb386e50b19c2e Sep 11 20:47:28.019287 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.019266 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2"] Sep 11 20:47:28.022357 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:28.022334 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95846d7c_4087_48a7_8669_0ed8fe317d27.slice/crio-06151a92509d223bc67add02142f59b6ba13351cfea94d16ffabef4f7f306a07 WatchSource:0}: Error finding container 06151a92509d223bc67add02142f59b6ba13351cfea94d16ffabef4f7f306a07: Status 404 returned error can't find the container with id 06151a92509d223bc67add02142f59b6ba13351cfea94d16ffabef4f7f306a07 Sep 11 20:47:28.022765 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.022745 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-545d45ff8-zzggt"] Sep 11 20:47:28.024709 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:28.024686 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40419021_de22_4665_a40a_b9152ca10a7f.slice/crio-07c2e8ec50648c9cb2f633df859093faa911ff6ea2f179cc13afd76350fed6cb WatchSource:0}: Error finding container 07c2e8ec50648c9cb2f633df859093faa911ff6ea2f179cc13afd76350fed6cb: Status 404 returned error can't find the container with id 07c2e8ec50648c9cb2f633df859093faa911ff6ea2f179cc13afd76350fed6cb Sep 11 20:47:28.059864 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.059830 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.158076 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.158037 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.259872 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.259794 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.412120 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.412090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.618135 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.618101 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.751451 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.751418 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.852777 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.852682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:28.915865 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.915769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" event={"ID":"40419021-de22-4665-a40a-b9152ca10a7f","Type":"ContainerStarted","Data":"668e8f6f26babf5177127d4884a67f8ad7c16343e3fac6d037364cbc00ac7ebe"} Sep 11 20:47:28.915865 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.915827 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" event={"ID":"40419021-de22-4665-a40a-b9152ca10a7f","Type":"ContainerStarted","Data":"07c2e8ec50648c9cb2f633df859093faa911ff6ea2f179cc13afd76350fed6cb"} Sep 11 20:47:28.916546 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.916527 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:28.932594 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.932559 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" event={"ID":"95846d7c-4087-48a7-8669-0ed8fe317d27","Type":"ContainerStarted","Data":"06151a92509d223bc67add02142f59b6ba13351cfea94d16ffabef4f7f306a07"} Sep 11 20:47:28.934539 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.934511 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-f4nht" event={"ID":"8ccd1221-f95d-423e-8046-28a4208d64e7","Type":"ContainerStarted","Data":"afbc8bc2da5cdbedeeeb9e39e0757fb99749d208a9ab08851dcb386e50b19c2e"} Sep 11 20:47:28.937054 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.937026 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" event={"ID":"8a221ef3-550a-44fb-9851-6e8dc1ea163f","Type":"ContainerStarted","Data":"b80f5099eb0c18949244f22a63d49dc58d9e867d65cc3a3f260911da962ac611"} Sep 11 20:47:28.943672 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:28.943590 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" podStartSLOduration=1.943574197 podStartE2EDuration="1.943574197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:28.942565995 +0000 UTC m=+63.875965016" watchObservedRunningTime="2026-09-11 20:47:28.943574197 +0000 UTC m=+63.876973218" Sep 11 20:47:29.201548 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.201448 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:29.303036 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.302996 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:29.663117 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.663086 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:29.719855 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.719780 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:29.943015 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.942922 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" event={"ID":"95846d7c-4087-48a7-8669-0ed8fe317d27","Type":"ContainerStarted","Data":"81a1fffb11d9155ca6703401eba0c387200926832f4412e8add9900a3982d681"} Sep 11 20:47:29.943499 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.943151 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:29.949158 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.949134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" Sep 11 20:47:29.962326 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:29.962264 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wsrw2" podStartSLOduration=1.606799916 podStartE2EDuration="2.962246791s" totalImagesPullingTime="1.355446875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:29.961664202 +0000 UTC m=+64.895063231" watchObservedRunningTime="2026-09-11 20:47:29.962246791 +0000 UTC m=+64.895645821" Sep 11 20:47:30.321017 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.320975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:47:30.321198 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.321063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:47:30.323950 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.323921 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 20:47:30.323950 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.323943 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 20:47:30.334642 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.334614 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37c7e377-0b57-4cb3-9573-f3e36e1f7aba-original-pull-secret\") pod \"global-pull-secret-syncer-hsn6q\" (UID: \"37c7e377-0b57-4cb3-9573-f3e36e1f7aba\") " pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:47:30.334750 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.334621 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02b51b0-219a-43d0-b1a6-d899d810b803-metrics-certs\") pod \"network-metrics-daemon-xzslg\" (UID: \"e02b51b0-219a-43d0-b1a6-d899d810b803\") " pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:47:30.422109 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.422070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:47:30.424802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.424770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 20:47:30.432140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.432111 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn6q" Sep 11 20:47:30.435447 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.435423 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 20:47:30.438152 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.437826 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:30.440732 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.440711 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p8x26\"" Sep 11 20:47:30.446415 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.446389 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zqr2\" (UniqueName: \"kubernetes.io/projected/15719e0e-2c1e-4a6a-86f8-d9d9e3952714-kube-api-access-2zqr2\") pod \"network-check-target-xccmr\" (UID: \"15719e0e-2c1e-4a6a-86f8-d9d9e3952714\") " pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:47:30.448886 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.448860 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xzslg" Sep 11 20:47:30.537660 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.537582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:30.752149 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.752121 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn5l2\"" Sep 11 20:47:30.756239 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.756212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:47:30.899603 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.899559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:30.986943 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:30.986308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:31.090082 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.090042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:31.230090 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.230051 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xccmr"] Sep 11 20:47:31.232653 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.232623 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hsn6q"] Sep 11 20:47:31.235029 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.234986 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xzslg"] Sep 11 20:47:31.330734 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:31.330701 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15719e0e_2c1e_4a6a_86f8_d9d9e3952714.slice/crio-0c9727622650b46efcd3a16347d8319b85ff575a52c430a1e3f6866926929ed6 WatchSource:0}: Error finding container 0c9727622650b46efcd3a16347d8319b85ff575a52c430a1e3f6866926929ed6: Status 404 returned error can't find the container with id 0c9727622650b46efcd3a16347d8319b85ff575a52c430a1e3f6866926929ed6 Sep 11 20:47:31.331853 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:31.331825 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c7e377_0b57_4cb3_9573_f3e36e1f7aba.slice/crio-3f7ed88e74dc715e8b6b19a304e1aa09aca74dc5429f447149c81cedf1ba34fa WatchSource:0}: Error finding container 3f7ed88e74dc715e8b6b19a304e1aa09aca74dc5429f447149c81cedf1ba34fa: Status 404 returned error can't find the container with id 3f7ed88e74dc715e8b6b19a304e1aa09aca74dc5429f447149c81cedf1ba34fa Sep 11 20:47:31.332426 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:31.332404 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02b51b0_219a_43d0_b1a6_d899d810b803.slice/crio-7c2f0ee4eedce5e6a2efac0dd85fb78e7dec6ca9033ad38ccea9d559577d9225 WatchSource:0}: Error finding container 7c2f0ee4eedce5e6a2efac0dd85fb78e7dec6ca9033ad38ccea9d559577d9225: Status 404 returned error can't find the container with id 7c2f0ee4eedce5e6a2efac0dd85fb78e7dec6ca9033ad38ccea9d559577d9225 Sep 11 20:47:31.952272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.952221 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xccmr" event={"ID":"15719e0e-2c1e-4a6a-86f8-d9d9e3952714","Type":"ContainerStarted","Data":"0c9727622650b46efcd3a16347d8319b85ff575a52c430a1e3f6866926929ed6"} Sep 11 20:47:31.953687 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.953626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hsn6q" event={"ID":"37c7e377-0b57-4cb3-9573-f3e36e1f7aba","Type":"ContainerStarted","Data":"3f7ed88e74dc715e8b6b19a304e1aa09aca74dc5429f447149c81cedf1ba34fa"} Sep 11 20:47:31.955379 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.955348 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xzslg" event={"ID":"e02b51b0-219a-43d0-b1a6-d899d810b803","Type":"ContainerStarted","Data":"7c2f0ee4eedce5e6a2efac0dd85fb78e7dec6ca9033ad38ccea9d559577d9225"} Sep 11 20:47:31.957394 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.957340 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" event={"ID":"8a221ef3-550a-44fb-9851-6e8dc1ea163f","Type":"ContainerStarted","Data":"f0d922eb21aa8c77e470fde1de0054421c66aebbdc8d979511ef6f470b098945"} Sep 11 20:47:31.974953 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:31.974892 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85d7bfc978-jk24t" podStartSLOduration=1.515297498 podStartE2EDuration="4.974871833s" totalImagesPullingTime="3.459574335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:31.973215805 +0000 UTC m=+66.906614827" watchObservedRunningTime="2026-09-11 20:47:31.974871833 +0000 UTC m=+66.908270862" Sep 11 20:47:32.702096 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.702047 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5865cdfcf5-wpkz7"] Sep 11 20:47:32.705112 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.705082 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.707822 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.707800 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 11 20:47:32.709162 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.708819 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 11 20:47:32.709162 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.709054 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tk4zv\"" Sep 11 20:47:32.709162 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.709106 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 11 20:47:32.709398 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.709280 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 11 20:47:32.710958 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.709821 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 11 20:47:32.711596 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.711577 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5865cdfcf5-wpkz7"] Sep 11 20:47:32.748478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.748116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-serving-cert\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.748478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.748160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-config\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.748478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.748209 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmnj\" (UniqueName: \"kubernetes.io/projected/543cf8e7-8703-4f1b-91cb-ee474223eb00-kube-api-access-fhmnj\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.748478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.748238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-oauth-config\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.748478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.748260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-service-ca\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.748478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.748281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-oauth-serving-cert\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.849503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmnj\" (UniqueName: \"kubernetes.io/projected/543cf8e7-8703-4f1b-91cb-ee474223eb00-kube-api-access-fhmnj\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.849547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-oauth-config\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.849694 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-service-ca\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.849733 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-oauth-serving-cert\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.849789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-serving-cert\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.849818 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-config\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.850946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.850612 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-oauth-serving-cert\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.851257 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.851003 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-service-ca\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.851257 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.851005 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-config\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.854152 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.854107 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-oauth-config\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.855815 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.855724 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-serving-cert\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.860770 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.860747 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmnj\" (UniqueName: \"kubernetes.io/projected/543cf8e7-8703-4f1b-91cb-ee474223eb00-kube-api-access-fhmnj\") pod \"console-5865cdfcf5-wpkz7\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:32.963748 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:32.963612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xzslg" event={"ID":"e02b51b0-219a-43d0-b1a6-d899d810b803","Type":"ContainerStarted","Data":"6feb78da66fa8abfff0c682cf2abb74dd4908071b952f96e50efb56b3620db76"} Sep 11 20:47:33.019054 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.019019 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:33.065049 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.065011 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:33.192124 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.192056 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:33.310986 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.310900 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5865cdfcf5-wpkz7"] Sep 11 20:47:33.320371 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:33.319380 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543cf8e7_8703_4f1b_91cb_ee474223eb00.slice/crio-3e63ef9525e04dcf767bf8d109a002621ccfb3956fcbb0bf8cf1414a1dc26a55 WatchSource:0}: Error finding container 3e63ef9525e04dcf767bf8d109a002621ccfb3956fcbb0bf8cf1414a1dc26a55: Status 404 returned error can't find the container with id 3e63ef9525e04dcf767bf8d109a002621ccfb3956fcbb0bf8cf1414a1dc26a55 Sep 11 20:47:33.758332 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.758284 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:33.971499 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.971465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xzslg" event={"ID":"e02b51b0-219a-43d0-b1a6-d899d810b803","Type":"ContainerStarted","Data":"a8c29c8bb05cc339c41bc3e002ded593ca69382f6bae8abd247f65874732d019"} Sep 11 20:47:33.973095 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.973066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865cdfcf5-wpkz7" event={"ID":"543cf8e7-8703-4f1b-91cb-ee474223eb00","Type":"ContainerStarted","Data":"3e63ef9525e04dcf767bf8d109a002621ccfb3956fcbb0bf8cf1414a1dc26a55"} Sep 11 20:47:33.989763 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:33.988737 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xzslg" podStartSLOduration=67.627717215 podStartE2EDuration="1m8.988718459s" totalImagesPullingTime="1.361001244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:33.988427659 +0000 UTC m=+68.921826687" watchObservedRunningTime="2026-09-11 20:47:33.988718459 +0000 UTC m=+68.922117489" Sep 11 20:47:34.083810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:34.083703 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:34.175904 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:34.175830 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:35.230543 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:35.230434 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:35.330526 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:35.330453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.044500 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.044452 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.172503 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.172452 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.274068 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.273857 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.333361 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.333328 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r5xn6"] Sep 11 20:47:36.336775 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.336748 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.340566 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.340538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 20:47:36.340566 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.340556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 20:47:36.341006 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.340981 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kth7b\"" Sep 11 20:47:36.341122 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.341105 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 20:47:36.341468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.341451 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 20:47:36.341580 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.341543 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 20:47:36.342218 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.342061 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 20:47:36.378492 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378492 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-metrics-client-ca\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-root\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-wtmp\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-sys\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-tls\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.378731 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n72mf\" (UniqueName: \"kubernetes.io/projected/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-kube-api-access-n72mf\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.379013 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.378752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-textfile\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.388174 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.388124 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.478548 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.478466 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.479518 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479644 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-root\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479644 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479593 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-wtmp\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-sys\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-tls\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n72mf\" (UniqueName: \"kubernetes.io/projected/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-kube-api-access-n72mf\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479890 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-textfile\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479890 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479762 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-wtmp\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479890 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.479890 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-metrics-client-ca\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.480077 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479969 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-sys\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.480077 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.479601 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-root\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.480168 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.480083 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-textfile\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.480451 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.480429 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.480451 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.480441 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-metrics-client-ca\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.482897 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.482852 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.483366 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.483302 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-node-exporter-tls\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.493185 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.493155 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n72mf\" (UniqueName: \"kubernetes.io/projected/caf32e22-58bb-45e2-8ad7-11cd8d4c1734-kube-api-access-n72mf\") pod \"node-exporter-r5xn6\" (UID: \"caf32e22-58bb-45e2-8ad7-11cd8d4c1734\") " pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.579702 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.579648 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:36.652921 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.652834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5xn6" Sep 11 20:47:36.682306 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:36.682263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.023354 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.023234 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.121796 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.121762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.225096 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.225060 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.338025 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.337989 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.445770 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.445722 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.453357 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.453306 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:47:37.458546 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.458519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.460932 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.460908 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 20:47:37.461067 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461050 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 20:47:37.461124 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.460908 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 20:47:37.461124 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461107 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 20:47:37.461228 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.460916 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 20:47:37.461295 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461275 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 20:47:37.461919 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461531 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 20:47:37.461919 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461553 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 20:47:37.461919 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461674 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 20:47:37.461919 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.461772 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6xskq\"" Sep 11 20:47:37.474867 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.474837 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:47:37.487595 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487595 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487600 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4gqg\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-kube-api-access-x4gqg\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487691 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-volume\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.487831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.488075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.488075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487887 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.488075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-web-config\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.488075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.487952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-out\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.548068 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.548033 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.589160 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589288 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4gqg\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-kube-api-access-x4gqg\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589489 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589489 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589489 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589489 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-volume\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-web-config\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.589688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.589642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-out\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.593059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.590461 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.593059 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:37.590747 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle podName:0df887b6-bb73-4205-aab8-d64f3ec9b047 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:38.090722798 +0000 UTC m=+73.024121835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047") : configmap references non-existent config key: ca-bundle.crt Sep 11 20:47:37.593059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.591893 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.593059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.592509 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-out\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.594210 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.594058 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-web-config\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.594210 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.594058 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-volume\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.594719 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.594675 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.595135 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.595116 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.595560 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.595536 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.595919 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.595893 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.596017 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.595997 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.596996 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.596962 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.610441 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.610275 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4gqg\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-kube-api-access-x4gqg\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:37.648728 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.648679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:37.747211 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:37.747176 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:38.093715 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:38.093672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:38.094614 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:38.094588 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:38.372369 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:38.372272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:47:39.119018 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:39.118948 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf32e22_58bb_45e2_8ad7_11cd8d4c1734.slice/crio-feae42c0f7efab85002169d14c4b60eb50c190bd75683dcd8dbce3bd8414c134 WatchSource:0}: Error finding container feae42c0f7efab85002169d14c4b60eb50c190bd75683dcd8dbce3bd8414c134: Status 404 returned error can't find the container with id feae42c0f7efab85002169d14c4b60eb50c190bd75683dcd8dbce3bd8414c134 Sep 11 20:47:39.196696 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:39.196658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:39.280611 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:39.280483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:39.342971 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:39.342901 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:39.408496 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:39.408467 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:47:39.443472 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:39.443428 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:40.001499 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.001459 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xccmr" event={"ID":"15719e0e-2c1e-4a6a-86f8-d9d9e3952714","Type":"ContainerStarted","Data":"c48f8aaae91eac8d3bdc02db3cc742609f5ea510f42ac1ad6fded557ac14eac0"} Sep 11 20:47:40.001692 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.001645 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:47:40.003510 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.003482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hsn6q" event={"ID":"37c7e377-0b57-4cb3-9573-f3e36e1f7aba","Type":"ContainerStarted","Data":"d6871760be295aeb2e9608ccdab059ffd94b9b15fc9409dcb009d491a384a5b6"} Sep 11 20:47:40.005377 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.005346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865cdfcf5-wpkz7" event={"ID":"543cf8e7-8703-4f1b-91cb-ee474223eb00","Type":"ContainerStarted","Data":"fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c"} Sep 11 20:47:40.006786 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.006762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5xn6" event={"ID":"caf32e22-58bb-45e2-8ad7-11cd8d4c1734","Type":"ContainerStarted","Data":"feae42c0f7efab85002169d14c4b60eb50c190bd75683dcd8dbce3bd8414c134"} Sep 11 20:47:40.016709 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.016664 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xccmr" podStartSLOduration=67.263047776 podStartE2EDuration="1m15.016646432s" totalImagesPullingTime="7.753598656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:40.015160595 +0000 UTC m=+74.948559624" watchObservedRunningTime="2026-09-11 20:47:40.016646432 +0000 UTC m=+74.950045458" Sep 11 20:47:40.029117 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.029062 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hsn6q" podStartSLOduration=67.267859251 podStartE2EDuration="1m15.029044532s" totalImagesPullingTime="7.761185281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:40.028276469 +0000 UTC m=+74.961675496" watchObservedRunningTime="2026-09-11 20:47:40.029044532 +0000 UTC m=+74.962443559" Sep 11 20:47:40.042490 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.042427 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5865cdfcf5-wpkz7" podStartSLOduration=2.242842241 podStartE2EDuration="8.042407151s" totalImagesPullingTime="5.79956491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:40.042162735 +0000 UTC m=+74.975561762" watchObservedRunningTime="2026-09-11 20:47:40.042407151 +0000 UTC m=+74.975806178" Sep 11 20:47:40.786706 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.786672 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85f9994b66-psrg7"] Sep 11 20:47:40.790604 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.790580 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.801153 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.801132 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 11 20:47:40.801255 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.801240 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 11 20:47:40.801818 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.801797 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 20:47:40.802563 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.802546 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b0sp1ebd1skma\"" Sep 11 20:47:40.802722 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.802703 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qz55l\"" Sep 11 20:47:40.810183 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.810161 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 11 20:47:40.819416 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30c8808c-d360-4c82-b42c-f1480c59fd7c-metrics-server-audit-profiles\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.819511 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-secret-metrics-server-tls\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.819511 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819490 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30c8808c-d360-4c82-b42c-f1480c59fd7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.819616 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-secret-metrics-server-client-certs\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.819616 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-client-ca-bundle\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.819616 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2vt\" (UniqueName: \"kubernetes.io/projected/30c8808c-d360-4c82-b42c-f1480c59fd7c-kube-api-access-sj2vt\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.819736 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.819624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30c8808c-d360-4c82-b42c-f1480c59fd7c-audit-log\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.851216 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.851184 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f9994b66-psrg7"] Sep 11 20:47:40.920556 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30c8808c-d360-4c82-b42c-f1480c59fd7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.920746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-secret-metrics-server-client-certs\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.920746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-client-ca-bundle\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.920746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2vt\" (UniqueName: \"kubernetes.io/projected/30c8808c-d360-4c82-b42c-f1480c59fd7c-kube-api-access-sj2vt\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.920746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30c8808c-d360-4c82-b42c-f1480c59fd7c-audit-log\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.920746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30c8808c-d360-4c82-b42c-f1480c59fd7c-metrics-server-audit-profiles\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.920746 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.920743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-secret-metrics-server-tls\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.921393 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.921363 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30c8808c-d360-4c82-b42c-f1480c59fd7c-audit-log\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.921516 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.921414 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30c8808c-d360-4c82-b42c-f1480c59fd7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.921834 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.921802 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30c8808c-d360-4c82-b42c-f1480c59fd7c-metrics-server-audit-profiles\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.923770 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.923743 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-secret-metrics-server-tls\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.923868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.923789 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-secret-metrics-server-client-certs\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.923868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.923790 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30c8808c-d360-4c82-b42c-f1480c59fd7c-client-ca-bundle\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:40.929938 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:40.929918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2vt\" (UniqueName: \"kubernetes.io/projected/30c8808c-d360-4c82-b42c-f1480c59fd7c-kube-api-access-sj2vt\") pod \"metrics-server-85f9994b66-psrg7\" (UID: \"30c8808c-d360-4c82-b42c-f1480c59fd7c\") " pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:41.067991 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.067901 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:41.068376 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.068353 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9"] Sep 11 20:47:41.071357 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.071336 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.086451 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.086417 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-grdwr\"" Sep 11 20:47:41.086583 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.086516 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 11 20:47:41.088342 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.088256 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9"] Sep 11 20:47:41.101493 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.101471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:47:41.122854 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.122825 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c484550-6024-4df3-aefa-cb751cc03eb1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.122992 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.122967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbk4j\" (UniqueName: \"kubernetes.io/projected/7c484550-6024-4df3-aefa-cb751cc03eb1-kube-api-access-qbk4j\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.194094 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.194058 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:41.224336 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.224283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbk4j\" (UniqueName: \"kubernetes.io/projected/7c484550-6024-4df3-aefa-cb751cc03eb1-kube-api-access-qbk4j\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.224510 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.224395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c484550-6024-4df3-aefa-cb751cc03eb1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.224569 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:41.224505 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 11 20:47:41.224616 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:47:41.224574 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c484550-6024-4df3-aefa-cb751cc03eb1-monitoring-plugin-cert podName:7c484550-6024-4df3-aefa-cb751cc03eb1 nodeName:}" failed. No retries permitted until 2026-09-11 20:47:41.72455312 +0000 UTC m=+76.657952141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7c484550-6024-4df3-aefa-cb751cc03eb1-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-xtpt9" (UID: "7c484550-6024-4df3-aefa-cb751cc03eb1") : secret "monitoring-plugin-cert" not found Sep 11 20:47:41.233826 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.233798 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbk4j\" (UniqueName: \"kubernetes.io/projected/7c484550-6024-4df3-aefa-cb751cc03eb1-kube-api-access-qbk4j\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.468802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.468764 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:41.617364 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.617288 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b97d5c585-dblf4"] Sep 11 20:47:41.620948 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.620919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.629993 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.629971 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 11 20:47:41.630133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.629972 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 11 20:47:41.630133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.629975 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 11 20:47:41.630450 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.630432 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wxrrn\"" Sep 11 20:47:41.630541 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.630506 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 11 20:47:41.630604 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.630553 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 11 20:47:41.635346 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.635266 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 11 20:47:41.638557 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.638537 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b97d5c585-dblf4"] Sep 11 20:47:41.729530 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-metrics-client-ca\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729530 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-serving-certs-ca-bundle\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729645 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729680 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjd85\" (UniqueName: \"kubernetes.io/projected/201ed15a-89d8-41e4-819c-50bf15db6bf4-kube-api-access-tjd85\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729887 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-secret-telemeter-client\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729887 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-federate-client-tls\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729986 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-telemeter-client-tls\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.729986 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.729957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c484550-6024-4df3-aefa-cb751cc03eb1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.732592 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.732569 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c484550-6024-4df3-aefa-cb751cc03eb1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xtpt9\" (UID: \"7c484550-6024-4df3-aefa-cb751cc03eb1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:41.830939 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.830893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-secret-telemeter-client\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.830971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-federate-client-tls\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-telemeter-client-tls\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-metrics-client-ca\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-serving-certs-ca-bundle\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjd85\" (UniqueName: \"kubernetes.io/projected/201ed15a-89d8-41e4-819c-50bf15db6bf4-kube-api-access-tjd85\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831857 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-metrics-client-ca\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.831931 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-serving-certs-ca-bundle\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.832758 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.832698 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201ed15a-89d8-41e4-819c-50bf15db6bf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.834120 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.834063 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-federate-client-tls\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.834120 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.834086 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-secret-telemeter-client\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.834411 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.834389 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.834492 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.834458 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/201ed15a-89d8-41e4-819c-50bf15db6bf4-telemeter-client-tls\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.839597 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.839573 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjd85\" (UniqueName: \"kubernetes.io/projected/201ed15a-89d8-41e4-819c-50bf15db6bf4-kube-api-access-tjd85\") pod \"telemeter-client-b97d5c585-dblf4\" (UID: \"201ed15a-89d8-41e4-819c-50bf15db6bf4\") " pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.931110 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.931073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" Sep 11 20:47:41.981386 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:41.981292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:42.466036 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.466002 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:47:42.469071 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.469049 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.471019 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.470996 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:42.471800 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.471777 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 20:47:42.471912 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.471815 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 20:47:42.472054 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.472028 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 20:47:42.472054 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.472048 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 20:47:42.472281 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.472266 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 20:47:42.472542 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.472524 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nzz6d\"" Sep 11 20:47:42.473140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.472847 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 20:47:42.473140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.472929 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 20:47:42.473298 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473192 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 20:47:42.473298 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473260 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 20:47:42.473425 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473297 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1ed9n0m31gp9c\"" Sep 11 20:47:42.473579 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473556 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 20:47:42.473681 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473640 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 20:47:42.473681 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473670 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 20:47:42.473901 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.473882 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 20:47:42.475486 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.475471 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 20:47:42.489407 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.489384 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:47:42.537082 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537272 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537487 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537487 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537487 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537416 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537487 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537487 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537660 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537660 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-config\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537660 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537576 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537660 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.537810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.537794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65rmh\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-kube-api-access-65rmh\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.638834 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.638834 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-config\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.638989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639080 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65rmh\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-kube-api-access-65rmh\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639171 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639292 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.639945 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.639547 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.640062 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.640004 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.640359 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.640336 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.640453 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.640337 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.643865 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.642691 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.643865 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.643116 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.643865 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.643377 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.643865 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.643771 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.644147 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.643923 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.644259 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.644212 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.644427 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.644395 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.644427 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.644412 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-config\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.644880 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.644858 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.645305 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.645283 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.645945 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.645924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.646472 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.646439 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.646688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.646667 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.646688 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.646681 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.648063 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.648041 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.648520 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.648498 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65rmh\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-kube-api-access-65rmh\") pod \"prometheus-k8s-0\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.735116 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.735034 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:42.781797 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.781754 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:47:42.907059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:42.907019 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:43.020007 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:43.019913 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:43.020007 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:43.019991 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:43.025949 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:43.025915 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:44.030906 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:44.030872 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:47:44.119095 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:44.119056 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:44.193778 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:44.193727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:44.665801 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:44.665747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:44.719843 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:44.719808 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:46.396136 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:46.396095 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df887b6_bb73_4205_aab8_d64f3ec9b047.slice/crio-ed06fbffc844c7c05798a960376f65b3212ceb2754a9a8bd28ea464e6a3fff35 WatchSource:0}: Error finding container ed06fbffc844c7c05798a960376f65b3212ceb2754a9a8bd28ea464e6a3fff35: Status 404 returned error can't find the container with id ed06fbffc844c7c05798a960376f65b3212ceb2754a9a8bd28ea464e6a3fff35 Sep 11 20:47:46.681591 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:46.681565 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f9994b66-psrg7"] Sep 11 20:47:46.687585 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:46.687562 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9"] Sep 11 20:47:46.697582 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:46.697556 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:47:46.700242 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:46.700216 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b97d5c585-dblf4"] Sep 11 20:47:46.727682 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:46.727635 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c8808c_d360_4c82_b42c_f1480c59fd7c.slice/crio-7af63dae08d61ceec4ca08c5a7372c9e5e7edeaedf8eb9bfc002e051ae24f60a WatchSource:0}: Error finding container 7af63dae08d61ceec4ca08c5a7372c9e5e7edeaedf8eb9bfc002e051ae24f60a: Status 404 returned error can't find the container with id 7af63dae08d61ceec4ca08c5a7372c9e5e7edeaedf8eb9bfc002e051ae24f60a Sep 11 20:47:46.728433 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:46.728393 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c484550_6024_4df3_aefa_cb751cc03eb1.slice/crio-68debdc93a25e16cdddb3fd897b193203b5d494754f751c8af60ea8c3e3b07fe WatchSource:0}: Error finding container 68debdc93a25e16cdddb3fd897b193203b5d494754f751c8af60ea8c3e3b07fe: Status 404 returned error can't find the container with id 68debdc93a25e16cdddb3fd897b193203b5d494754f751c8af60ea8c3e3b07fe Sep 11 20:47:46.729627 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:46.729555 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbde680_a228_4a1a_acd8_35ce5d572c78.slice/crio-9ed90ae446512ecb10b8e7915f92a47b8db7b61dde78bfd435db89d83129fc59 WatchSource:0}: Error finding container 9ed90ae446512ecb10b8e7915f92a47b8db7b61dde78bfd435db89d83129fc59: Status 404 returned error can't find the container with id 9ed90ae446512ecb10b8e7915f92a47b8db7b61dde78bfd435db89d83129fc59 Sep 11 20:47:46.730249 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:47:46.730227 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201ed15a_89d8_41e4_819c_50bf15db6bf4.slice/crio-9af127f5e0f394ff8d3b0157490e34517c4db5334af2c992f87b8f8609dad452 WatchSource:0}: Error finding container 9af127f5e0f394ff8d3b0157490e34517c4db5334af2c992f87b8f8609dad452: Status 404 returned error can't find the container with id 9af127f5e0f394ff8d3b0157490e34517c4db5334af2c992f87b8f8609dad452 Sep 11 20:47:47.026935 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.026891 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:47.038647 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.038614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" event={"ID":"7c484550-6024-4df3-aefa-cb751cc03eb1","Type":"ContainerStarted","Data":"68debdc93a25e16cdddb3fd897b193203b5d494754f751c8af60ea8c3e3b07fe"} Sep 11 20:47:47.039893 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.039863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" event={"ID":"30c8808c-d360-4c82-b42c-f1480c59fd7c","Type":"ContainerStarted","Data":"7af63dae08d61ceec4ca08c5a7372c9e5e7edeaedf8eb9bfc002e051ae24f60a"} Sep 11 20:47:47.041482 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.041447 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-f4nht" event={"ID":"8ccd1221-f95d-423e-8046-28a4208d64e7","Type":"ContainerStarted","Data":"b7b3cbdee4233dda401e90a2a7eb7b3902db021eec1b15d2e6da8636e64d8caa"} Sep 11 20:47:47.041639 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.041619 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:47.042640 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.042614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" event={"ID":"201ed15a-89d8-41e4-819c-50bf15db6bf4","Type":"ContainerStarted","Data":"9af127f5e0f394ff8d3b0157490e34517c4db5334af2c992f87b8f8609dad452"} Sep 11 20:47:47.043022 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.042999 2560 patch_prober.go:28] interesting pod/downloads-76f99584f4-f4nht container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body= Sep 11 20:47:47.043093 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.043047 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-f4nht" podUID="8ccd1221-f95d-423e-8046-28a4208d64e7" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" Sep 11 20:47:47.043840 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.043820 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"9ed90ae446512ecb10b8e7915f92a47b8db7b61dde78bfd435db89d83129fc59"} Sep 11 20:47:47.044923 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.044905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"ed06fbffc844c7c05798a960376f65b3212ceb2754a9a8bd28ea464e6a3fff35"} Sep 11 20:47:47.058166 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.058098 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-f4nht" podStartSLOduration=1.243182687 podStartE2EDuration="20.05807366s" totalImagesPullingTime="18.814890973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:47.057154164 +0000 UTC m=+81.990553314" watchObservedRunningTime="2026-09-11 20:47:47.05807366 +0000 UTC m=+81.991472688" Sep 11 20:47:47.127873 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:47.127782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:48.060569 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:48.059979 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5xn6" event={"ID":"caf32e22-58bb-45e2-8ad7-11cd8d4c1734","Type":"ContainerStarted","Data":"bedaf583331063bb5b3e4e6aadfa2e6054889e6e7936d888181226105cbf3a47"} Sep 11 20:47:48.064030 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:48.063968 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-f4nht" Sep 11 20:47:49.068028 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:49.067916 2560 generic.go:356] "Generic (PLEG): container finished" podID="caf32e22-58bb-45e2-8ad7-11cd8d4c1734" containerID="bedaf583331063bb5b3e4e6aadfa2e6054889e6e7936d888181226105cbf3a47" exitCode=0 Sep 11 20:47:49.069458 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:49.068173 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5xn6" event={"ID":"caf32e22-58bb-45e2-8ad7-11cd8d4c1734","Type":"ContainerDied","Data":"bedaf583331063bb5b3e4e6aadfa2e6054889e6e7936d888181226105cbf3a47"} Sep 11 20:47:49.230850 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:49.230779 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:49.331697 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:49.331661 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:50.358988 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:50.358911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:50.460478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:50.460443 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:50.951007 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:50.950981 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-545d45ff8-zzggt" Sep 11 20:47:51.049733 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:51.049696 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:51.108654 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:51.108410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:51.196735 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:51.196567 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:51.392741 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:51.392683 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:52.084823 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.084785 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445" exitCode=0 Sep 11 20:47:52.085231 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.084876 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445"} Sep 11 20:47:52.087188 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.087165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" event={"ID":"7c484550-6024-4df3-aefa-cb751cc03eb1","Type":"ContainerStarted","Data":"8127acef2b5dfc319000bdb899d7d6bfbfa04f2d42d40fba7b7ce0ba9d3d30a9"} Sep 11 20:47:52.087283 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.087217 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:52.089262 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.089229 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" event={"ID":"30c8808c-d360-4c82-b42c-f1480c59fd7c","Type":"ContainerStarted","Data":"52886b4a6ba7c64705b1981cfa5bce72f18e382154d68e38e2d2eb16f01ee929"} Sep 11 20:47:52.093099 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.093068 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5xn6" event={"ID":"caf32e22-58bb-45e2-8ad7-11cd8d4c1734","Type":"ContainerStarted","Data":"ebd6436163611a87848578b62f7ba0384e72fee5cd6811498e3924e06979da55"} Sep 11 20:47:52.093208 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.093130 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5xn6" event={"ID":"caf32e22-58bb-45e2-8ad7-11cd8d4c1734","Type":"ContainerStarted","Data":"91775fa8d3e904c5df06e711fa5b735c09135e8ec2f2b0c61f267ff8e0c87b50"} Sep 11 20:47:52.093307 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.093284 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" Sep 11 20:47:52.096269 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.096235 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" event={"ID":"201ed15a-89d8-41e4-819c-50bf15db6bf4","Type":"ContainerStarted","Data":"1484d71da1817356990aa35709a8eb1c57526069ee3426ea9dd4abf8924a429d"} Sep 11 20:47:52.096392 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.096300 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" event={"ID":"201ed15a-89d8-41e4-819c-50bf15db6bf4","Type":"ContainerStarted","Data":"97820a0c2b29342014a41581a65f5244d3f037040c17e0fbc24147a4ec1d3459"} Sep 11 20:47:52.096392 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.096350 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" event={"ID":"201ed15a-89d8-41e4-819c-50bf15db6bf4","Type":"ContainerStarted","Data":"ca1e71f4262250d28ad2c3ce1135726c8f5bacd6f259d83b49dc3d19790a427c"} Sep 11 20:47:52.098037 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.098005 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" exitCode=0 Sep 11 20:47:52.098151 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.098042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} Sep 11 20:47:52.152628 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.152560 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" podStartSLOduration=7.891210987 podStartE2EDuration="12.152535185s" totalImagesPullingTime="4.261324198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:52.14859509 +0000 UTC m=+87.081994129" watchObservedRunningTime="2026-09-11 20:47:52.152535185 +0000 UTC m=+87.085934212" Sep 11 20:47:52.178636 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.178577 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b97d5c585-dblf4" podStartSLOduration=6.910839849 podStartE2EDuration="11.178560839s" totalImagesPullingTime="4.26772099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:52.176683554 +0000 UTC m=+87.110082581" watchObservedRunningTime="2026-09-11 20:47:52.178560839 +0000 UTC m=+87.111959866" Sep 11 20:47:52.196635 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.196575 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r5xn6" podStartSLOduration=7.883169648 podStartE2EDuration="16.196558172s" totalImagesPullingTime="8.200489593s" totalInitContainerRuntime="112.898931ms" isStatefulPod=true podCreationTimestamp="2026-09-11 20:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:52.194681263 +0000 UTC m=+87.128080303" watchObservedRunningTime="2026-09-11 20:47:52.196558172 +0000 UTC m=+87.129957199" Sep 11 20:47:52.211931 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.211872 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xtpt9" podStartSLOduration=6.948739222 podStartE2EDuration="11.211849071s" totalImagesPullingTime="4.263109849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:52.210065588 +0000 UTC m=+87.143464617" watchObservedRunningTime="2026-09-11 20:47:52.211849071 +0000 UTC m=+87.145248099" Sep 11 20:47:52.849942 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.849896 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:52.943744 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:52.943708 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:53.146651 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:53.146549 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:53.225232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:53.225202 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:57.127734 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.127695 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} Sep 11 20:47:57.128164 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.127768 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} Sep 11 20:47:57.130560 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.130534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d"} Sep 11 20:47:57.130673 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.130597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c"} Sep 11 20:47:57.130673 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.130624 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5"} Sep 11 20:47:57.130673 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.130650 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf"} Sep 11 20:47:57.130673 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:57.130673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b"} Sep 11 20:47:59.141916 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:59.141873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerStarted","Data":"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd"} Sep 11 20:47:59.167705 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:59.167658 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=12.31452252 podStartE2EDuration="22.167638498s" totalImagesPullingTime="9.823737793s" totalInitContainerRuntime="29.378185ms" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:47:59.165541185 +0000 UTC m=+94.098940212" watchObservedRunningTime="2026-09-11 20:47:59.167638498 +0000 UTC m=+94.101037525" Sep 11 20:47:59.384386 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:59.384354 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:59.484638 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:59.484617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:59.664721 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:59.664683 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:47:59.718493 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:47:59.718419 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:00.149763 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:00.149724 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} Sep 11 20:48:00.150222 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:00.149801 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} Sep 11 20:48:00.150222 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:00.149833 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} Sep 11 20:48:00.150222 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:00.149863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerStarted","Data":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} Sep 11 20:48:00.180071 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:00.180010 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.035427708 podStartE2EDuration="18.179987316s" totalImagesPullingTime="11.087053935s" totalInitContainerRuntime="57.505673ms" isStatefulPod=false podCreationTimestamp="2026-09-11 20:47:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:48:00.178518418 +0000 UTC m=+95.111917454" watchObservedRunningTime="2026-09-11 20:48:00.179987316 +0000 UTC m=+95.113386344" Sep 11 20:48:01.102064 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:01.102023 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:48:01.102238 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:01.102121 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:48:02.782185 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:02.782151 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:48:03.642776 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:03.642738 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:03.743241 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:03.743209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:04.213964 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:04.213927 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5865cdfcf5-wpkz7"] Sep 11 20:48:04.658251 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:04.658217 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:04.717406 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:04.717374 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:11.014278 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:11.014249 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xccmr" Sep 11 20:48:14.666593 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:14.666564 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:14.751703 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:14.751674 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:21.107496 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:21.107464 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:48:21.111133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:21.111114 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85f9994b66-psrg7" Sep 11 20:48:21.560679 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:21.560596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:21.663607 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:21.663570 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:29.234099 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.234059 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5865cdfcf5-wpkz7" podUID="543cf8e7-8703-4f1b-91cb-ee474223eb00" containerName="console" containerID="cri-o://fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c" gracePeriod=15 Sep 11 20:48:29.508058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.507998 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:48:29.571831 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.571800 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhmnj\" (UniqueName: \"kubernetes.io/projected/543cf8e7-8703-4f1b-91cb-ee474223eb00-kube-api-access-fhmnj\") pod \"543cf8e7-8703-4f1b-91cb-ee474223eb00\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " Sep 11 20:48:29.571989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.571880 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-serving-cert\") pod \"543cf8e7-8703-4f1b-91cb-ee474223eb00\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " Sep 11 20:48:29.571989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.571912 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-service-ca\") pod \"543cf8e7-8703-4f1b-91cb-ee474223eb00\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " Sep 11 20:48:29.571989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.571930 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-config\") pod \"543cf8e7-8703-4f1b-91cb-ee474223eb00\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " Sep 11 20:48:29.571989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.571946 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-oauth-serving-cert\") pod \"543cf8e7-8703-4f1b-91cb-ee474223eb00\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " Sep 11 20:48:29.571989 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.571976 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-oauth-config\") pod \"543cf8e7-8703-4f1b-91cb-ee474223eb00\" (UID: \"543cf8e7-8703-4f1b-91cb-ee474223eb00\") " Sep 11 20:48:29.572360 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.572330 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-config" (OuterVolumeSpecName: "console-config") pod "543cf8e7-8703-4f1b-91cb-ee474223eb00" (UID: "543cf8e7-8703-4f1b-91cb-ee474223eb00"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:48:29.572475 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.572303 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-service-ca" (OuterVolumeSpecName: "service-ca") pod "543cf8e7-8703-4f1b-91cb-ee474223eb00" (UID: "543cf8e7-8703-4f1b-91cb-ee474223eb00"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:48:29.572475 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.572411 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "543cf8e7-8703-4f1b-91cb-ee474223eb00" (UID: "543cf8e7-8703-4f1b-91cb-ee474223eb00"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:48:29.574207 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.574178 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "543cf8e7-8703-4f1b-91cb-ee474223eb00" (UID: "543cf8e7-8703-4f1b-91cb-ee474223eb00"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:29.574285 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.574189 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543cf8e7-8703-4f1b-91cb-ee474223eb00-kube-api-access-fhmnj" (OuterVolumeSpecName: "kube-api-access-fhmnj") pod "543cf8e7-8703-4f1b-91cb-ee474223eb00" (UID: "543cf8e7-8703-4f1b-91cb-ee474223eb00"). InnerVolumeSpecName "kube-api-access-fhmnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 20:48:29.574285 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.574246 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "543cf8e7-8703-4f1b-91cb-ee474223eb00" (UID: "543cf8e7-8703-4f1b-91cb-ee474223eb00"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:29.672631 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.672594 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-serving-cert\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:29.672794 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.672655 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-service-ca\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:29.672794 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.672669 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-config\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:29.672794 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.672680 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/543cf8e7-8703-4f1b-91cb-ee474223eb00-oauth-serving-cert\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:29.672794 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.672693 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/543cf8e7-8703-4f1b-91cb-ee474223eb00-console-oauth-config\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:29.672794 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:29.672705 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhmnj\" (UniqueName: \"kubernetes.io/projected/543cf8e7-8703-4f1b-91cb-ee474223eb00-kube-api-access-fhmnj\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:30.267804 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.267774 2560 generic.go:356] "Generic (PLEG): container finished" podID="543cf8e7-8703-4f1b-91cb-ee474223eb00" containerID="fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c" exitCode=0 Sep 11 20:48:30.268151 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.267816 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865cdfcf5-wpkz7" Sep 11 20:48:30.268151 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.267818 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865cdfcf5-wpkz7" event={"ID":"543cf8e7-8703-4f1b-91cb-ee474223eb00","Type":"ContainerDied","Data":"fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c"} Sep 11 20:48:30.268151 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.267943 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865cdfcf5-wpkz7" event={"ID":"543cf8e7-8703-4f1b-91cb-ee474223eb00","Type":"ContainerDied","Data":"3e63ef9525e04dcf767bf8d109a002621ccfb3956fcbb0bf8cf1414a1dc26a55"} Sep 11 20:48:30.268151 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.267970 2560 scope.go:117] "RemoveContainer" containerID="fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c" Sep 11 20:48:30.287424 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.287390 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5865cdfcf5-wpkz7"] Sep 11 20:48:30.291614 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.291579 2560 scope.go:117] "RemoveContainer" containerID="fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c" Sep 11 20:48:30.292106 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:30.292080 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c\": container with ID starting with fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c not found: ID does not exist" containerID="fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c" Sep 11 20:48:30.292262 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.292227 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c"} err="failed to get container status \"fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c\": rpc error: code = NotFound desc = could not find container \"fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c\": container with ID starting with fd8b3eeaa34d7f2b028157f484b1d57f56b1e860487f1ef94ba3419bd0ce6d2c not found: ID does not exist" Sep 11 20:48:30.293384 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:30.293365 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5865cdfcf5-wpkz7"] Sep 11 20:48:31.526148 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:31.526115 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543cf8e7-8703-4f1b-91cb-ee474223eb00" path="/var/lib/kubelet/pods/543cf8e7-8703-4f1b-91cb-ee474223eb00/volumes" Sep 11 20:48:42.782489 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:42.782451 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:48:42.852369 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:42.852341 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:48:43.341609 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:43.341577 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:48:52.366212 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:52.366166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:52.540154 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:52.540108 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:56.605927 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.605891 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:48:56.606303 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.606186 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="alertmanager" containerID="cri-o://6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b" gracePeriod=120 Sep 11 20:48:56.606303 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.606253 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-metric" containerID="cri-o://47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d" gracePeriod=120 Sep 11 20:48:56.606303 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.606267 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-web" containerID="cri-o://73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5" gracePeriod=120 Sep 11 20:48:56.606519 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.606300 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="prom-label-proxy" containerID="cri-o://f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd" gracePeriod=120 Sep 11 20:48:56.606519 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.606339 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="config-reloader" containerID="cri-o://6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf" gracePeriod=120 Sep 11 20:48:56.606519 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:56.606358 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy" containerID="cri-o://8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c" gracePeriod=120 Sep 11 20:48:57.384826 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384793 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd" exitCode=0 Sep 11 20:48:57.384826 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384817 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c" exitCode=0 Sep 11 20:48:57.384826 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384824 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf" exitCode=0 Sep 11 20:48:57.384826 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384831 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b" exitCode=0 Sep 11 20:48:57.385121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd"} Sep 11 20:48:57.385121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384928 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c"} Sep 11 20:48:57.385121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384956 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf"} Sep 11 20:48:57.385121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.384982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b"} Sep 11 20:48:57.836360 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:57.836305 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.027888 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027804 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-main-db\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.027888 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027841 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-cluster-tls-config\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.027888 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027863 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027895 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4gqg\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-kube-api-access-x4gqg\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027929 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027958 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-out\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.027984 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-volume\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028133 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028011 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-web\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028398 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028176 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 20:48:58.028398 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028248 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028398 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028300 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-tls-assets\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028398 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028368 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-web-config\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028609 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028425 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-metrics-client-ca\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028609 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028483 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-main-tls\") pod \"0df887b6-bb73-4205-aab8-d64f3ec9b047\" (UID: \"0df887b6-bb73-4205-aab8-d64f3ec9b047\") " Sep 11 20:48:58.028974 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.028737 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-main-db\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.029515 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.029482 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:48:58.029515 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.029494 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:48:58.031216 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.031178 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.031755 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.031706 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.031843 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.031800 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-kube-api-access-x4gqg" (OuterVolumeSpecName: "kube-api-access-x4gqg") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "kube-api-access-x4gqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 20:48:58.031924 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.031907 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.032095 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.032073 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.032186 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.032165 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-volume" (OuterVolumeSpecName: "config-volume") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.032259 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.032236 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-out" (OuterVolumeSpecName: "config-out") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 20:48:58.032631 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.032611 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 20:48:58.035567 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.035491 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.042181 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.042156 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-web-config" (OuterVolumeSpecName: "web-config") pod "0df887b6-bb73-4205-aab8-d64f3ec9b047" (UID: "0df887b6-bb73-4205-aab8-d64f3ec9b047"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:48:58.130109 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130066 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-tls-assets\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130109 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130102 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-web-config\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130109 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130116 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-metrics-client-ca\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130129 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-main-tls\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130141 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-cluster-tls-config\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130153 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130167 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4gqg\" (UniqueName: \"kubernetes.io/projected/0df887b6-bb73-4205-aab8-d64f3ec9b047-kube-api-access-x4gqg\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130179 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130191 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-out\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130203 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-config-volume\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130216 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df887b6-bb73-4205-aab8-d64f3ec9b047-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.130421 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.130227 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df887b6-bb73-4205-aab8-d64f3ec9b047-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:48:58.392121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392085 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d" exitCode=0 Sep 11 20:48:58.392121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392111 2560 generic.go:356] "Generic (PLEG): container finished" podID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerID="73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5" exitCode=0 Sep 11 20:48:58.392375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d"} Sep 11 20:48:58.392375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392157 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.392375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5"} Sep 11 20:48:58.392375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392249 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df887b6-bb73-4205-aab8-d64f3ec9b047","Type":"ContainerDied","Data":"ed06fbffc844c7c05798a960376f65b3212ceb2754a9a8bd28ea464e6a3fff35"} Sep 11 20:48:58.392375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.392276 2560 scope.go:117] "RemoveContainer" containerID="f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd" Sep 11 20:48:58.399873 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.399853 2560 scope.go:117] "RemoveContainer" containerID="47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d" Sep 11 20:48:58.407282 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.407266 2560 scope.go:117] "RemoveContainer" containerID="8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c" Sep 11 20:48:58.415039 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.415013 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:48:58.415768 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.415752 2560 scope.go:117] "RemoveContainer" containerID="73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5" Sep 11 20:48:58.418800 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.418778 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:48:58.422855 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.422838 2560 scope.go:117] "RemoveContainer" containerID="6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf" Sep 11 20:48:58.429472 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.429454 2560 scope.go:117] "RemoveContainer" containerID="6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b" Sep 11 20:48:58.436162 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.436147 2560 scope.go:117] "RemoveContainer" containerID="93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445" Sep 11 20:48:58.444353 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.444309 2560 scope.go:117] "RemoveContainer" containerID="f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd" Sep 11 20:48:58.444707 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.444681 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd\": container with ID starting with f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd not found: ID does not exist" containerID="f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd" Sep 11 20:48:58.444779 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.444714 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd"} err="failed to get container status \"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd\": rpc error: code = NotFound desc = could not find container \"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd\": container with ID starting with f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd not found: ID does not exist" Sep 11 20:48:58.444779 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.444735 2560 scope.go:117] "RemoveContainer" containerID="47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d" Sep 11 20:48:58.445005 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.444990 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d\": container with ID starting with 47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d not found: ID does not exist" containerID="47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d" Sep 11 20:48:58.445048 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445009 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d"} err="failed to get container status \"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d\": rpc error: code = NotFound desc = could not find container \"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d\": container with ID starting with 47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d not found: ID does not exist" Sep 11 20:48:58.445048 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445022 2560 scope.go:117] "RemoveContainer" containerID="8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c" Sep 11 20:48:58.445259 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.445238 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c\": container with ID starting with 8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c not found: ID does not exist" containerID="8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c" Sep 11 20:48:58.445377 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445262 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c"} err="failed to get container status \"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c\": rpc error: code = NotFound desc = could not find container \"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c\": container with ID starting with 8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c not found: ID does not exist" Sep 11 20:48:58.445377 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445277 2560 scope.go:117] "RemoveContainer" containerID="73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5" Sep 11 20:48:58.445620 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.445589 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5\": container with ID starting with 73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5 not found: ID does not exist" containerID="73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5" Sep 11 20:48:58.445676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445620 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5"} err="failed to get container status \"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5\": rpc error: code = NotFound desc = could not find container \"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5\": container with ID starting with 73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5 not found: ID does not exist" Sep 11 20:48:58.445676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445640 2560 scope.go:117] "RemoveContainer" containerID="6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf" Sep 11 20:48:58.445906 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.445888 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf\": container with ID starting with 6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf not found: ID does not exist" containerID="6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf" Sep 11 20:48:58.445967 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445910 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf"} err="failed to get container status \"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf\": rpc error: code = NotFound desc = could not find container \"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf\": container with ID starting with 6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf not found: ID does not exist" Sep 11 20:48:58.445967 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.445924 2560 scope.go:117] "RemoveContainer" containerID="6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b" Sep 11 20:48:58.446187 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.446168 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b\": container with ID starting with 6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b not found: ID does not exist" containerID="6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b" Sep 11 20:48:58.446240 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446189 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b"} err="failed to get container status \"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b\": rpc error: code = NotFound desc = could not find container \"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b\": container with ID starting with 6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b not found: ID does not exist" Sep 11 20:48:58.446240 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446200 2560 scope.go:117] "RemoveContainer" containerID="93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445" Sep 11 20:48:58.446496 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:48:58.446474 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445\": container with ID starting with 93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445 not found: ID does not exist" containerID="93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445" Sep 11 20:48:58.446535 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446500 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445"} err="failed to get container status \"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445\": rpc error: code = NotFound desc = could not find container \"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445\": container with ID starting with 93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445 not found: ID does not exist" Sep 11 20:48:58.446535 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446515 2560 scope.go:117] "RemoveContainer" containerID="f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd" Sep 11 20:48:58.446770 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446752 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd"} err="failed to get container status \"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd\": rpc error: code = NotFound desc = could not find container \"f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd\": container with ID starting with f538d2e8cd23d459bc9b00ffc089f7d6d7992423652e0e9fa3d836025fb43cfd not found: ID does not exist" Sep 11 20:48:58.446810 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446772 2560 scope.go:117] "RemoveContainer" containerID="47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d" Sep 11 20:48:58.447005 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.446988 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d"} err="failed to get container status \"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d\": rpc error: code = NotFound desc = could not find container \"47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d\": container with ID starting with 47b0af4aedbad3f4178092401b9293cafe210c4f81286696a71ae2976aa3144d not found: ID does not exist" Sep 11 20:48:58.447042 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447007 2560 scope.go:117] "RemoveContainer" containerID="8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c" Sep 11 20:48:58.447204 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447186 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c"} err="failed to get container status \"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c\": rpc error: code = NotFound desc = could not find container \"8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c\": container with ID starting with 8facc18007341d74a89ae5b9eb1664caddc5b5811dba87d6df789a70bc25775c not found: ID does not exist" Sep 11 20:48:58.447267 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447205 2560 scope.go:117] "RemoveContainer" containerID="73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5" Sep 11 20:48:58.447446 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447426 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5"} err="failed to get container status \"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5\": rpc error: code = NotFound desc = could not find container \"73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5\": container with ID starting with 73e15d38e280783057d44074eba092df4fd2e8f1f7ffc2640a4d54db542ee9a5 not found: ID does not exist" Sep 11 20:48:58.447446 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447444 2560 scope.go:117] "RemoveContainer" containerID="6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf" Sep 11 20:48:58.447684 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447666 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf"} err="failed to get container status \"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf\": rpc error: code = NotFound desc = could not find container \"6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf\": container with ID starting with 6d69da3bc8c37fc57472b5a4e2c6b5ec83b40df04fbc2db3f7a81291307b7dcf not found: ID does not exist" Sep 11 20:48:58.447739 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447685 2560 scope.go:117] "RemoveContainer" containerID="6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b" Sep 11 20:48:58.447900 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447878 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b"} err="failed to get container status \"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b\": rpc error: code = NotFound desc = could not find container \"6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b\": container with ID starting with 6d1d7cee0c517b94b7167dd5a965c85faa359ece7739a7ffd4d094266cff996b not found: ID does not exist" Sep 11 20:48:58.447951 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.447902 2560 scope.go:117] "RemoveContainer" containerID="93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445" Sep 11 20:48:58.448270 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.448235 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445"} err="failed to get container status \"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445\": rpc error: code = NotFound desc = could not find container \"93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445\": container with ID starting with 93cba49ed040b1237a428eddd5cb6fe61466a740546d1c4f43d331779686f445 not found: ID does not exist" Sep 11 20:48:58.450459 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450439 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:48:58.450727 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450716 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-metric" Sep 11 20:48:58.450767 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450730 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-metric" Sep 11 20:48:58.450767 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450745 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-web" Sep 11 20:48:58.450767 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450753 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-web" Sep 11 20:48:58.450767 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450764 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450770 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450778 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="alertmanager" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450783 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="alertmanager" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450790 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="prom-label-proxy" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450795 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="prom-label-proxy" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450805 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543cf8e7-8703-4f1b-91cb-ee474223eb00" containerName="console" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450812 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="543cf8e7-8703-4f1b-91cb-ee474223eb00" containerName="console" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450823 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="init-config-reloader" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450829 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="init-config-reloader" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450837 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="config-reloader" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450842 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="config-reloader" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450897 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="543cf8e7-8703-4f1b-91cb-ee474223eb00" containerName="console" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450906 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="prom-label-proxy" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450912 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-metric" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450918 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="config-reloader" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450923 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450928 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="kube-rbac-proxy-web" Sep 11 20:48:58.450947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.450933 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" containerName="alertmanager" Sep 11 20:48:58.454188 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.454174 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.456748 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.456724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 20:48:58.456862 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.456735 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 20:48:58.457105 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457088 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 20:48:58.457190 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457123 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 20:48:58.457190 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457167 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 20:48:58.457295 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457287 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 20:48:58.457375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457297 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6xskq\"" Sep 11 20:48:58.457375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457297 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 20:48:58.457375 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.457298 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 20:48:58.462159 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.462138 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 20:48:58.470775 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.470752 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:48:58.635664 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/723a15b9-c3f9-46ed-ba46-0895859811b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635664 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/723a15b9-c3f9-46ed-ba46-0895859811b1-config-out\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-web-config\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/723a15b9-c3f9-46ed-ba46-0895859811b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635991 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xrw\" (UniqueName: \"kubernetes.io/projected/723a15b9-c3f9-46ed-ba46-0895859811b1-kube-api-access-27xrw\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.635991 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.635980 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.636092 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.636049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/723a15b9-c3f9-46ed-ba46-0895859811b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.636141 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.636100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/723a15b9-c3f9-46ed-ba46-0895859811b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.636188 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.636148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.636188 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.636177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.636367 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.636229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737140 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737388 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737388 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/723a15b9-c3f9-46ed-ba46-0895859811b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737388 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737211 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/723a15b9-c3f9-46ed-ba46-0895859811b1-config-out\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737388 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-web-config\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737429 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/723a15b9-c3f9-46ed-ba46-0895859811b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xrw\" (UniqueName: \"kubernetes.io/projected/723a15b9-c3f9-46ed-ba46-0895859811b1-kube-api-access-27xrw\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/723a15b9-c3f9-46ed-ba46-0895859811b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.737637 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.737608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/723a15b9-c3f9-46ed-ba46-0895859811b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.738106 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.738082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/723a15b9-c3f9-46ed-ba46-0895859811b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.738361 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.738339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/723a15b9-c3f9-46ed-ba46-0895859811b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.740339 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.740259 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741084 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.740682 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/723a15b9-c3f9-46ed-ba46-0895859811b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741084 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.740826 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-web-config\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741084 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.740876 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/723a15b9-c3f9-46ed-ba46-0895859811b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741084 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.740983 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741084 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.740983 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741348 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.741120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741348 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.741203 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741348 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.741240 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/723a15b9-c3f9-46ed-ba46-0895859811b1-config-out\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.741988 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.741959 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/723a15b9-c3f9-46ed-ba46-0895859811b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.745630 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.745612 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xrw\" (UniqueName: \"kubernetes.io/projected/723a15b9-c3f9-46ed-ba46-0895859811b1-kube-api-access-27xrw\") pod \"alertmanager-main-0\" (UID: \"723a15b9-c3f9-46ed-ba46-0895859811b1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:58.763478 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:58.763455 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 20:48:59.042227 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.042203 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 20:48:59.043703 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:48:59.043671 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723a15b9_c3f9_46ed_ba46_0895859811b1.slice/crio-ff9a46855a6aefc91e3910ca81a28767dd4bd87e303b08728922ed8c2825f26f WatchSource:0}: Error finding container ff9a46855a6aefc91e3910ca81a28767dd4bd87e303b08728922ed8c2825f26f: Status 404 returned error can't find the container with id ff9a46855a6aefc91e3910ca81a28767dd4bd87e303b08728922ed8c2825f26f Sep 11 20:48:59.397538 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.397505 2560 generic.go:356] "Generic (PLEG): container finished" podID="723a15b9-c3f9-46ed-ba46-0895859811b1" containerID="662ab073b70efcdae857d4376464942a64c0ffd6a3acb32b150ad7335ee57860" exitCode=0 Sep 11 20:48:59.397734 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.397663 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerDied","Data":"662ab073b70efcdae857d4376464942a64c0ffd6a3acb32b150ad7335ee57860"} Sep 11 20:48:59.397805 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.397760 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"ff9a46855a6aefc91e3910ca81a28767dd4bd87e303b08728922ed8c2825f26f"} Sep 11 20:48:59.398753 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.398718 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:59.501453 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.501421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:48:59.526209 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:48:59.526182 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df887b6-bb73-4205-aab8-d64f3ec9b047" path="/var/lib/kubelet/pods/0df887b6-bb73-4205-aab8-d64f3ec9b047/volumes" Sep 11 20:49:00.406718 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.406686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"5c99aeab0a442a3aeb7694aba8daae98332f7ae665dcc08fe5654784a72ff992"} Sep 11 20:49:00.407083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.406747 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"363ccb80aa0a6d1f74afdcc123f9f7e3d10935185a01e94012a39efaa6f484de"} Sep 11 20:49:00.407083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.406774 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"f25fad57b4edd2d99cadaf28b90826c447ff5ff11522fd6ada66973a5f25de3b"} Sep 11 20:49:00.407083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.406804 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"f74c46dc31626dbacd2276f9295ade115a38ed0004ad7e681e6c07d73b43783a"} Sep 11 20:49:00.407083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.406827 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"682757d4698796dae4099c67113e6fe173237f65ac53abb36e28f0b8edbd0c4b"} Sep 11 20:49:00.407083 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.406850 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"723a15b9-c3f9-46ed-ba46-0895859811b1","Type":"ContainerStarted","Data":"8721d25931666ceccdb069381c7ddd20995603c98fd06b80a4de2b24bcab0b46"} Sep 11 20:49:00.431626 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.431577 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.415476924 podStartE2EDuration="2.431561647s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.084723ms" isStatefulPod=false podCreationTimestamp="2026-09-11 20:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:49:00.429084039 +0000 UTC m=+155.362483075" watchObservedRunningTime="2026-09-11 20:49:00.431561647 +0000 UTC m=+155.364960673" Sep 11 20:49:00.827862 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.827830 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:49:00.828143 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.828103 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="prometheus" containerID="cri-o://0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" gracePeriod=600 Sep 11 20:49:00.828279 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.828131 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy" containerID="cri-o://4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" gracePeriod=600 Sep 11 20:49:00.828279 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.828150 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="config-reloader" containerID="cri-o://2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" gracePeriod=600 Sep 11 20:49:00.828279 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.828167 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-web" containerID="cri-o://8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" gracePeriod=600 Sep 11 20:49:00.828279 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.828178 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" gracePeriod=600 Sep 11 20:49:00.828279 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:00.828140 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="thanos-sidecar" containerID="cri-o://0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" gracePeriod=600 Sep 11 20:49:01.060955 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.060928 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.155812 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155738 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-serving-certs-ca-bundle\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.155812 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155781 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-config\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.155812 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155806 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-2\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155828 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-grpc-tls\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155851 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-metrics-client-ca\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155891 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-trusted-ca-bundle\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155921 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-thanos-prometheus-http-client-file\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155952 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-tls-assets\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.155979 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-web-config\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156003 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156033 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156069 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-kube-rbac-proxy\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156094 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-1\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156123 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-metrics-client-certs\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156146 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-kubelet-serving-ca-bundle\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156172 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65rmh\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-kube-api-access-65rmh\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156206 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-tls\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156203 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156227 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156245 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-db\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156468 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156251 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.156941 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156704 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.156941 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156712 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.156941 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156822 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-config-out\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.156941 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.156898 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-0\") pod \"9fbde680-a228-4a1a-acd8-35ce5d572c78\" (UID: \"9fbde680-a228-4a1a-acd8-35ce5d572c78\") " Sep 11 20:49:01.157469 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.157310 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158266 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158392 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158412 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158428 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158564 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-db\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158579 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158594 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.158606 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.158608 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-configmap-metrics-client-ca\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.159762 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.159694 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 20:49:01.160005 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.159972 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-config" (OuterVolumeSpecName: "config") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.160412 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160154 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.160412 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160254 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.160412 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160263 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 20:49:01.160412 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160384 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.160630 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160513 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-kube-api-access-65rmh" (OuterVolumeSpecName: "kube-api-access-65rmh") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "kube-api-access-65rmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 20:49:01.160630 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160525 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.160706 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.160650 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.161032 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.161011 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.161250 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.161235 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-config-out" (OuterVolumeSpecName: "config-out") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 20:49:01.161449 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.161429 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.170092 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.170074 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-web-config" (OuterVolumeSpecName: "web-config") pod "9fbde680-a228-4a1a-acd8-35ce5d572c78" (UID: "9fbde680-a228-4a1a-acd8-35ce5d572c78"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 20:49:01.259177 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259147 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fbde680-a228-4a1a-acd8-35ce5d572c78-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259177 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259175 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-config\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259185 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-grpc-tls\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259194 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259203 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-tls-assets\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259210 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-web-config\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259221 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259236 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259245 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-kube-rbac-proxy\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259254 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-metrics-client-certs\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259262 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65rmh\" (UniqueName: \"kubernetes.io/projected/9fbde680-a228-4a1a-acd8-35ce5d572c78-kube-api-access-65rmh\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259269 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fbde680-a228-4a1a-acd8-35ce5d572c78-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.259338 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.259277 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbde680-a228-4a1a-acd8-35ce5d572c78-config-out\") on node \"ip-10-0-140-21.ec2.internal\" DevicePath \"\"" Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414186 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" exitCode=0 Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414211 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" exitCode=0 Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414217 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" exitCode=0 Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414224 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" exitCode=0 Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414231 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" exitCode=0 Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414239 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" exitCode=0 Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414257 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.414266 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414417 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414450 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414527 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} Sep 11 20:49:01.414994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.414568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fbde680-a228-4a1a-acd8-35ce5d572c78","Type":"ContainerDied","Data":"9ed90ae446512ecb10b8e7915f92a47b8db7b61dde78bfd435db89d83129fc59"} Sep 11 20:49:01.422076 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.422055 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.429131 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.429113 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.435670 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.435652 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.437739 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.437719 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:49:01.442783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.442767 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.446556 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.446539 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:49:01.449798 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.449771 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.456947 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.456932 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.463738 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.463722 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.464011 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.463994 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.464050 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464018 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} err="failed to get container status \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" Sep 11 20:49:01.464050 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464033 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.464273 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.464255 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.464350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464277 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} err="failed to get container status \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" Sep 11 20:49:01.464350 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464290 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.464521 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.464505 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.464561 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464525 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} err="failed to get container status \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" Sep 11 20:49:01.464561 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464538 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.464748 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.464733 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.464787 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464752 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} err="failed to get container status \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" Sep 11 20:49:01.464787 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464764 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.464959 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.464944 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.464995 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464964 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} err="failed to get container status \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" Sep 11 20:49:01.464995 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.464976 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.465205 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.465186 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.465245 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.465212 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} err="failed to get container status \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" Sep 11 20:49:01.465245 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.465228 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.465505 ip-10-0-140-21 kubenswrapper[2560]: E0911 20:49:01.465487 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.465589 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.465508 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} err="failed to get container status \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" Sep 11 20:49:01.465589 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.465521 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.465759 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.465739 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} err="failed to get container status \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" Sep 11 20:49:01.465794 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.465760 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.466017 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466001 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} err="failed to get container status \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" Sep 11 20:49:01.466075 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466019 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.466254 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466235 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} err="failed to get container status \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" Sep 11 20:49:01.466387 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466256 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.466552 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466535 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} err="failed to get container status \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" Sep 11 20:49:01.466592 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466553 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.466783 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466766 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} err="failed to get container status \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" Sep 11 20:49:01.466839 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.466783 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.467018 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467000 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} err="failed to get container status \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" Sep 11 20:49:01.467072 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467019 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.467298 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467282 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} err="failed to get container status \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" Sep 11 20:49:01.467298 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467298 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.467528 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467513 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} err="failed to get container status \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" Sep 11 20:49:01.467576 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467528 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.467734 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467715 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} err="failed to get container status \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" Sep 11 20:49:01.467776 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467735 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.467946 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467931 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} err="failed to get container status \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" Sep 11 20:49:01.467994 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.467945 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.468179 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468163 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} err="failed to get container status \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" Sep 11 20:49:01.468232 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468180 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.468431 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468415 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} err="failed to get container status \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" Sep 11 20:49:01.468431 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468430 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.468640 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468623 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} err="failed to get container status \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" Sep 11 20:49:01.468779 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468640 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.468940 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468890 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} err="failed to get container status \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" Sep 11 20:49:01.468940 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.468915 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.469245 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.469212 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} err="failed to get container status \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" Sep 11 20:49:01.469245 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.469238 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.469522 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.469500 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} err="failed to get container status \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" Sep 11 20:49:01.469602 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.469523 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.469799 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.469776 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} err="failed to get container status \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" Sep 11 20:49:01.469863 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.469801 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.470058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470037 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} err="failed to get container status \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" Sep 11 20:49:01.470058 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470057 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.470293 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470266 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} err="failed to get container status \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" Sep 11 20:49:01.470293 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470283 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.470546 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470522 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} err="failed to get container status \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" Sep 11 20:49:01.470546 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470545 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.470753 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470737 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} err="failed to get container status \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" Sep 11 20:49:01.470800 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.470753 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.471857 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472615 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="thanos-sidecar" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472646 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="thanos-sidecar" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472682 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-web" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472710 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-web" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472723 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="init-config-reloader" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472732 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="init-config-reloader" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472750 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="prometheus" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472758 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="prometheus" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472786 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="config-reloader" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472802 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="config-reloader" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472812 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-thanos" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472820 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-thanos" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472844 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.472864 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.473014 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-thanos" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.473027 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.473043 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="config-reloader" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.473052 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="kube-rbac-proxy-web" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.473063 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="prometheus" Sep 11 20:49:01.475657 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.473078 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" containerName="thanos-sidecar" Sep 11 20:49:01.476442 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.476399 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} err="failed to get container status \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" Sep 11 20:49:01.476442 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.476424 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.476693 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.476674 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} err="failed to get container status \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" Sep 11 20:49:01.476693 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.476692 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.476952 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.476934 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} err="failed to get container status \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" Sep 11 20:49:01.476992 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.476953 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.477221 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477203 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} err="failed to get container status \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" Sep 11 20:49:01.477269 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477221 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.477477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477461 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} err="failed to get container status \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" Sep 11 20:49:01.477477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477477 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.477713 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477695 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} err="failed to get container status \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" Sep 11 20:49:01.477782 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477716 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.477959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477939 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} err="failed to get container status \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" Sep 11 20:49:01.477959 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.477955 2560 scope.go:117] "RemoveContainer" containerID="4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42" Sep 11 20:49:01.478221 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478202 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42"} err="failed to get container status \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": rpc error: code = NotFound desc = could not find container \"4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42\": container with ID starting with 4c669d9a56efc3205911945eaac9d9d69b4f724afdd28c0b5a95f76fea7e5b42 not found: ID does not exist" Sep 11 20:49:01.478265 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478222 2560 scope.go:117] "RemoveContainer" containerID="4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579" Sep 11 20:49:01.478432 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478416 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579"} err="failed to get container status \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": rpc error: code = NotFound desc = could not find container \"4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579\": container with ID starting with 4fead8e60469765d31bd81bd710a44c21464534663b3f1627e544df938e7b579 not found: ID does not exist" Sep 11 20:49:01.478471 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478432 2560 scope.go:117] "RemoveContainer" containerID="8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299" Sep 11 20:49:01.478653 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478632 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299"} err="failed to get container status \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": rpc error: code = NotFound desc = could not find container \"8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299\": container with ID starting with 8b40fb9f3569ee418cde537539ec4ff4b242115ac12284d694a61a2c98b0f299 not found: ID does not exist" Sep 11 20:49:01.478653 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478649 2560 scope.go:117] "RemoveContainer" containerID="0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17" Sep 11 20:49:01.478860 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478841 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17"} err="failed to get container status \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": rpc error: code = NotFound desc = could not find container \"0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17\": container with ID starting with 0917c2e02d7cd2390d10ea8bf7271736adc34efa156e7d68d7ac0c6f031e0b17 not found: ID does not exist" Sep 11 20:49:01.478911 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.478861 2560 scope.go:117] "RemoveContainer" containerID="2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710" Sep 11 20:49:01.479076 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.479057 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710"} err="failed to get container status \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": rpc error: code = NotFound desc = could not find container \"2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710\": container with ID starting with 2f09457a4f227a5c815111b6887c4fb149a8333a4cff0549b53323dc0ef08710 not found: ID does not exist" Sep 11 20:49:01.479076 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.479075 2560 scope.go:117] "RemoveContainer" containerID="0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b" Sep 11 20:49:01.479225 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.479207 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.479283 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.479265 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b"} err="failed to get container status \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": rpc error: code = NotFound desc = could not find container \"0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b\": container with ID starting with 0f97d8cedddacddc74796933589793d488d9cbbb425a117415862d3d92b80f1b not found: ID does not exist" Sep 11 20:49:01.479414 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.479284 2560 scope.go:117] "RemoveContainer" containerID="037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28" Sep 11 20:49:01.479573 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.479537 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28"} err="failed to get container status \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": rpc error: code = NotFound desc = could not find container \"037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28\": container with ID starting with 037ba53c012cc2596e8628d2ecbddb593f0e8eeba8d15dd48a09caf35a878e28 not found: ID does not exist" Sep 11 20:49:01.481790 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.481772 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 20:49:01.482121 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482105 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 20:49:01.482183 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482156 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 20:49:01.482183 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482164 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 20:49:01.482291 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482177 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 20:49:01.482480 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482463 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 20:49:01.482545 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482484 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 20:49:01.482545 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482504 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nzz6d\"" Sep 11 20:49:01.482545 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482518 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1ed9n0m31gp9c\"" Sep 11 20:49:01.482545 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482533 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 20:49:01.482714 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482488 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 20:49:01.482714 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482488 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 20:49:01.483015 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.482999 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 20:49:01.483059 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.483037 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 20:49:01.485648 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.485620 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 20:49:01.488148 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.488127 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 20:49:01.489225 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.489205 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:49:01.525743 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.525708 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fbde680-a228-4a1a-acd8-35ce5d572c78" path="/var/lib/kubelet/pods/9fbde680-a228-4a1a-acd8-35ce5d572c78/volumes" Sep 11 20:49:01.562936 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.562900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563074 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.562942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec77c38-7f00-480c-bc47-fc2900ec35bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563074 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.562969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563074 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563074 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563050 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563212 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563212 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563212 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-config\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563212 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563212 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563338 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563474 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563682 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563682 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563682 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdzh5\" (UniqueName: \"kubernetes.io/projected/0ec77c38-7f00-480c-bc47-fc2900ec35bb-kube-api-access-zdzh5\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.563682 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.563533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec77c38-7f00-480c-bc47-fc2900ec35bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664366 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664366 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec77c38-7f00-480c-bc47-fc2900ec35bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664366 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664366 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664408 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-config\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.664676 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664814 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdzh5\" (UniqueName: \"kubernetes.io/projected/0ec77c38-7f00-480c-bc47-fc2900ec35bb-kube-api-access-zdzh5\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.664866 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec77c38-7f00-480c-bc47-fc2900ec35bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.665057 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.665132 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665200 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.665199 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665664 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.665491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.665664 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.665539 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.667627 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.667597 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.667750 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.667667 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec77c38-7f00-480c-bc47-fc2900ec35bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.667750 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.667681 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.667929 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.667898 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-config\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.668001 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.667936 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.668001 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.667954 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.668341 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.668267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.668572 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.668551 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.668683 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.668663 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec77c38-7f00-480c-bc47-fc2900ec35bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.668726 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.668681 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.669903 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.669876 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.670119 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.670102 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.670182 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.670166 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec77c38-7f00-480c-bc47-fc2900ec35bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.671026 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.671008 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ec77c38-7f00-480c-bc47-fc2900ec35bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.675378 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.675359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdzh5\" (UniqueName: \"kubernetes.io/projected/0ec77c38-7f00-480c-bc47-fc2900ec35bb-kube-api-access-zdzh5\") pod \"prometheus-k8s-0\" (UID: \"0ec77c38-7f00-480c-bc47-fc2900ec35bb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:01.789349 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:01.789292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:02.067824 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:02.067797 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 20:49:02.068970 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:49:02.068947 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec77c38_7f00_480c_bc47_fc2900ec35bb.slice/crio-a497ecc896963af3ec76f32f1bf7e4d8e620eb10c145c22f1ba5d08721023a12 WatchSource:0}: Error finding container a497ecc896963af3ec76f32f1bf7e4d8e620eb10c145c22f1ba5d08721023a12: Status 404 returned error can't find the container with id a497ecc896963af3ec76f32f1bf7e4d8e620eb10c145c22f1ba5d08721023a12 Sep 11 20:49:02.419979 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:02.419941 2560 generic.go:356] "Generic (PLEG): container finished" podID="0ec77c38-7f00-480c-bc47-fc2900ec35bb" containerID="3553cafddd5b76bba2ca8c14cd9a9673a151908c229508997f3935c5bfad7db2" exitCode=0 Sep 11 20:49:02.420425 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:02.420036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerDied","Data":"3553cafddd5b76bba2ca8c14cd9a9673a151908c229508997f3935c5bfad7db2"} Sep 11 20:49:02.420425 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:02.420111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"a497ecc896963af3ec76f32f1bf7e4d8e620eb10c145c22f1ba5d08721023a12"} Sep 11 20:49:03.429069 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.428977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"18fe403b0bae7820e58e58a85f5fe3c5588e2e9a8628b2d3bc2d8799c17017dc"} Sep 11 20:49:03.429069 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.429068 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"ba80cfc44bf575a42fd6802321876c1bb314639caa72d0c0a9a5aaf050e03d11"} Sep 11 20:49:03.429466 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.429094 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"6be93fb7df40284c643644cd0ce2bb05359fee7c9957ff69c483d2141ce3f5b1"} Sep 11 20:49:03.429466 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.429119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"37f568f54d2550716ecea60b77b035ceb9a0acc67bfe1adbebaae5c09249a019"} Sep 11 20:49:03.429466 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.429141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"079597f5aaae633e21dfcbe31a89743b2542da1c75a881a5db8a0bc4b2d28641"} Sep 11 20:49:03.429466 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.429167 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ec77c38-7f00-480c-bc47-fc2900ec35bb","Type":"ContainerStarted","Data":"1b66120944f8bed2804a29197635695bc7f068ffa9b425472eb994691170020c"} Sep 11 20:49:03.457362 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:03.457288 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.437383448 podStartE2EDuration="2.457270999s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.887551ms" isStatefulPod=false podCreationTimestamp="2026-09-11 20:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:49:03.455573982 +0000 UTC m=+158.388973035" watchObservedRunningTime="2026-09-11 20:49:03.457270999 +0000 UTC m=+158.390670025" Sep 11 20:49:04.258802 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:04.258771 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:04.356707 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:04.356661 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:06.790147 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:06.790109 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:49:10.523575 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:10.523536 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:10.579624 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:10.579594 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:10.641784 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:10.641736 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:14.667932 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:14.667881 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:14.769063 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:14.769026 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:40.787601 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:40.787567 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:52.028499 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:52.028467 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:52.127754 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:52.127715 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:53.938718 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:53.938679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:53.991274 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:53.991242 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" limit=1024 Sep 11 20:49:56.468068 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:56.468042 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hsn6q_37c7e377-0b57-4cb3-9573-f3e36e1f7aba/global-pull-secret-syncer/0.log" Sep 11 20:49:56.607775 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:56.607744 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-47xhm_8692ca9c-f056-40d5-b15e-c0ea8b69627f/konnectivity-agent/0.log" Sep 11 20:49:56.716760 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:49:56.716735 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-21.ec2.internal_dad58467d753112c5733ab02ffa92d87/haproxy/0.log" Sep 11 20:50:00.206435 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.206406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/alertmanager/0.log" Sep 11 20:50:00.242345 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.242279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/config-reloader/0.log" Sep 11 20:50:00.270975 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.270952 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/kube-rbac-proxy-web/0.log" Sep 11 20:50:00.300691 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.300654 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/kube-rbac-proxy/0.log" Sep 11 20:50:00.336872 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.336842 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/kube-rbac-proxy-metric/0.log" Sep 11 20:50:00.360705 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.360681 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/prom-label-proxy/0.log" Sep 11 20:50:00.386699 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.386672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_723a15b9-c3f9-46ed-ba46-0895859811b1/init-config-reloader/0.log" Sep 11 20:50:00.525242 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.525153 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85f9994b66-psrg7_30c8808c-d360-4c82-b42c-f1480c59fd7c/metrics-server/0.log" Sep 11 20:50:00.558988 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.558966 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-xtpt9_7c484550-6024-4df3-aefa-cb751cc03eb1/monitoring-plugin/0.log" Sep 11 20:50:00.677544 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.677521 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5xn6_caf32e22-58bb-45e2-8ad7-11cd8d4c1734/node-exporter/0.log" Sep 11 20:50:00.698118 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.698098 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5xn6_caf32e22-58bb-45e2-8ad7-11cd8d4c1734/kube-rbac-proxy/0.log" Sep 11 20:50:00.717415 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.717393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5xn6_caf32e22-58bb-45e2-8ad7-11cd8d4c1734/init-textfile/0.log" Sep 11 20:50:00.927202 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.927165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/prometheus/0.log" Sep 11 20:50:00.952021 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.951998 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/config-reloader/0.log" Sep 11 20:50:00.980347 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:00.980310 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/thanos-sidecar/0.log" Sep 11 20:50:01.001471 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.001445 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/kube-rbac-proxy-web/0.log" Sep 11 20:50:01.023785 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.023766 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/kube-rbac-proxy/0.log" Sep 11 20:50:01.044177 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.044156 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/kube-rbac-proxy-thanos/0.log" Sep 11 20:50:01.073479 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.073459 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ec77c38-7f00-480c-bc47-fc2900ec35bb/init-config-reloader/0.log" Sep 11 20:50:01.144456 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.144386 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-wsrw2_95846d7c-4087-48a7-8669-0ed8fe317d27/prometheus-operator-admission-webhook/0.log" Sep 11 20:50:01.173901 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.173867 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b97d5c585-dblf4_201ed15a-89d8-41e4-819c-50bf15db6bf4/telemeter-client/0.log" Sep 11 20:50:01.196063 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.196032 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b97d5c585-dblf4_201ed15a-89d8-41e4-819c-50bf15db6bf4/reload/0.log" Sep 11 20:50:01.222044 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.222004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b97d5c585-dblf4_201ed15a-89d8-41e4-819c-50bf15db6bf4/kube-rbac-proxy/0.log" Sep 11 20:50:01.790197 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.790156 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:50:01.804872 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:01.804845 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:50:02.682987 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:02.682958 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 20:50:03.518910 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:03.518881 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-f4nht_8ccd1221-f95d-423e-8046-28a4208d64e7/download-server/0.log" Sep 11 20:50:04.111081 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.111044 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd"] Sep 11 20:50:04.114156 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.114136 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.116472 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.116454 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xmk5p\"/\"kube-root-ca.crt\"" Sep 11 20:50:04.116566 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.116510 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xmk5p\"/\"openshift-service-ca.crt\"" Sep 11 20:50:04.117259 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.117243 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xmk5p\"/\"default-dockercfg-6lgc7\"" Sep 11 20:50:04.122819 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.122799 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd"] Sep 11 20:50:04.173190 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.173156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-proc\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.173372 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.173216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-podres\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.173372 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.173254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-lib-modules\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.173372 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.173288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-sys\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.173372 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.173310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2d58\" (UniqueName: \"kubernetes.io/projected/ccb38553-b764-4a6a-8066-2066c2ec2257-kube-api-access-q2d58\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.273999 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.273963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-podres\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274193 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-lib-modules\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274193 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-sys\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274193 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2d58\" (UniqueName: \"kubernetes.io/projected/ccb38553-b764-4a6a-8066-2066c2ec2257-kube-api-access-q2d58\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274193 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-proc\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274193 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274159 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-podres\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274500 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274173 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-proc\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274500 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274174 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-sys\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.274500 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.274215 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccb38553-b764-4a6a-8066-2066c2ec2257-lib-modules\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.281401 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.281377 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2d58\" (UniqueName: \"kubernetes.io/projected/ccb38553-b764-4a6a-8066-2066c2ec2257-kube-api-access-q2d58\") pod \"perf-node-gather-daemonset-6szgd\" (UID: \"ccb38553-b764-4a6a-8066-2066c2ec2257\") " pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.424563 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.424471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:04.688907 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.688883 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd"] Sep 11 20:50:04.691185 ip-10-0-140-21 kubenswrapper[2560]: W0911 20:50:04.691158 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podccb38553_b764_4a6a_8066_2066c2ec2257.slice/crio-1c330109a195fc985f4f8f826926f9424724e0f4d731482c4d772cc1c7c00c68 WatchSource:0}: Error finding container 1c330109a195fc985f4f8f826926f9424724e0f4d731482c4d772cc1c7c00c68: Status 404 returned error can't find the container with id 1c330109a195fc985f4f8f826926f9424724e0f4d731482c4d772cc1c7c00c68 Sep 11 20:50:04.873677 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.873652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsrxk_ab08e004-54f6-4959-aedf-06726e466290/dns/0.log" Sep 11 20:50:04.892145 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.892122 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsrxk_ab08e004-54f6-4959-aedf-06726e466290/kube-rbac-proxy/0.log" Sep 11 20:50:04.912235 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:04.912206 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hg6vw_1322470e-4e4c-4618-9fd0-be94e6fe37c1/dns-node-resolver/0.log" Sep 11 20:50:05.324780 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:05.324752 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-545d45ff8-zzggt_40419021-de22-4665-a40a-b9152ca10a7f/registry/0.log" Sep 11 20:50:05.347091 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:05.347067 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gffmh_63f266a3-8f0d-40b0-8794-38257bf5965c/node-ca/0.log" Sep 11 20:50:05.678438 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:05.678344 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" event={"ID":"ccb38553-b764-4a6a-8066-2066c2ec2257","Type":"ContainerStarted","Data":"a3e9696b4ef76b3a5b0be4dc203d0345f40ff3a337e968ba0f3f14804b3e8145"} Sep 11 20:50:05.678438 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:05.678405 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" event={"ID":"ccb38553-b764-4a6a-8066-2066c2ec2257","Type":"ContainerStarted","Data":"1c330109a195fc985f4f8f826926f9424724e0f4d731482c4d772cc1c7c00c68"} Sep 11 20:50:05.678622 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:05.678446 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:05.693687 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:05.693637 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" podStartSLOduration=1.6936226250000002 podStartE2EDuration="1.693622625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:50:05.692732303 +0000 UTC m=+220.626131332" watchObservedRunningTime="2026-09-11 20:50:05.693622625 +0000 UTC m=+220.627021650" Sep 11 20:50:06.346408 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:06.346378 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ztqch_93db5312-27cf-47ea-82c1-342181fc8d13/serve-healthcheck-canary/0.log" Sep 11 20:50:06.687500 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:06.687427 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fj96_fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb/kube-rbac-proxy/0.log" Sep 11 20:50:06.706295 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:06.706266 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fj96_fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb/exporter/0.log" Sep 11 20:50:06.725367 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:06.725343 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fj96_fb82c8ba-2a2a-4f5a-8a7b-3d9568c11ddb/extractor/0.log" Sep 11 20:50:10.467868 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:10.467841 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-xnhsn_63d92b7a-4485-4af6-b36b-89eefbe48c4c/migrator/0.log" Sep 11 20:50:10.486077 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:10.486031 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-xnhsn_63d92b7a-4485-4af6-b36b-89eefbe48c4c/graceful-termination/0.log" Sep 11 20:50:11.585485 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.585460 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/kube-multus-additional-cni-plugins/0.log" Sep 11 20:50:11.609705 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.609680 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/egress-router-binary-copy/0.log" Sep 11 20:50:11.631028 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.630998 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/cni-plugins/0.log" Sep 11 20:50:11.649722 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.649705 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/bond-cni-plugin/0.log" Sep 11 20:50:11.668614 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.668593 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/routeoverride-cni/0.log" Sep 11 20:50:11.686698 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.686680 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/whereabouts-cni-bincopy/0.log" Sep 11 20:50:11.690850 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.690827 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xmk5p/perf-node-gather-daemonset-6szgd" Sep 11 20:50:11.706737 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:11.706718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxc9v_dba4cda1-287c-4eba-8316-0fa1100249ba/whereabouts-cni/0.log" Sep 11 20:50:12.014005 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:12.013931 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cmtr2_8c456dbc-99f2-4a81-a556-fbf0bbbed523/kube-multus/0.log" Sep 11 20:50:12.145008 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:12.144980 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xzslg_e02b51b0-219a-43d0-b1a6-d899d810b803/network-metrics-daemon/0.log" Sep 11 20:50:12.163401 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:12.163377 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xzslg_e02b51b0-219a-43d0-b1a6-d899d810b803/kube-rbac-proxy/0.log" Sep 11 20:50:13.107477 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.107399 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/ovn-controller/0.log" Sep 11 20:50:13.125144 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.125117 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/ovn-acl-logging/0.log" Sep 11 20:50:13.145581 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.145557 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/kube-rbac-proxy-node/0.log" Sep 11 20:50:13.166093 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.166069 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 20:50:13.186420 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.186397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/northd/0.log" Sep 11 20:50:13.208412 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.208393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/nbdb/0.log" Sep 11 20:50:13.229273 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.229251 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/sbdb/0.log" Sep 11 20:50:13.264908 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:13.264878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p946_6705b5d7-c96e-49ac-a820-817edde97ca2/ovnkube-controller/0.log" Sep 11 20:50:14.389216 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:14.389184 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xccmr_15719e0e-2c1e-4a6a-86f8-d9d9e3952714/network-check-target-container/0.log" Sep 11 20:50:15.223179 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:15.223152 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-gvh85_403c152a-7714-4132-9b87-4364739ee54a/iptables-alerter/0.log" Sep 11 20:50:15.854167 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:15.854137 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pct25_eceef04f-754d-4de0-aada-8331db96c92a/tuned/0.log" Sep 11 20:50:18.594566 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:18.594531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-568869fdc5-9f7bt_e879f126-d9a0-4596-9c67-18a0a68df7ca/service-ca-controller/0.log" Sep 11 20:50:19.005900 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:19.005872 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wt69q_3a736981-daee-47f0-a35c-2d3979edac8b/csi-driver/0.log" Sep 11 20:50:19.028189 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:19.028153 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wt69q_3a736981-daee-47f0-a35c-2d3979edac8b/csi-node-driver-registrar/0.log" Sep 11 20:50:19.051705 ip-10-0-140-21 kubenswrapper[2560]: I0911 20:50:19.051683 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wt69q_3a736981-daee-47f0-a35c-2d3979edac8b/csi-liveness-probe/0.log"