Sep 17 02:41:51.300343 ip-10-0-135-174 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 02:41:51.300353 ip-10-0-135-174 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 02:41:51.300362 ip-10-0-135-174 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 02:41:51.300660 ip-10-0-135-174 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 02:42:00.971656 ip-10-0-135-174 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 02:42:00.971669 ip-10-0-135-174 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot de3192f8e62b4039ac69a258eae514f4 -- Sep 17 02:43:48.747066 ip-10-0-135-174 systemd[1]: Starting Kubernetes Kubelet... Sep 17 02:43:49.141845 ip-10-0-135-174 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 02:43:49.141845 ip-10-0-135-174 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 02:43:49.141845 ip-10-0-135-174 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 02:43:49.141845 ip-10-0-135-174 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 02:43:49.141845 ip-10-0-135-174 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 02:43:49.142889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.142805 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 02:43:49.145640 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145622 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 02:43:49.145640 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145639 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145643 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145648 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145650 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145654 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145656 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145659 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145662 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145665 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145668 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145671 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145674 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145676 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145679 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145682 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145685 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145687 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145690 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145692 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145695 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 02:43:49.145705 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145698 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145700 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145703 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145705 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145710 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145715 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145718 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145721 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145724 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145727 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145730 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145732 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145735 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145737 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145740 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145743 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145745 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145747 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145750 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 02:43:49.146194 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145753 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145756 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145758 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145760 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145763 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145765 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145768 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145771 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145773 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145776 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145778 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145796 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145799 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145802 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145804 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145807 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145811 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145813 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145818 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145820 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 02:43:49.146654 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145823 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145825 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145829 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145831 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145833 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145836 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145840 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145843 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145846 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145849 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145852 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145856 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145859 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145862 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145865 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145868 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145870 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145873 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145876 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 02:43:49.147270 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145880 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145883 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145886 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145889 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145892 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145895 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145897 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145900 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145903 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145906 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145908 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145911 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145914 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145916 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145919 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145922 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145924 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145927 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145930 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.145934 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 02:43:49.147731 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146648 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146655 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146658 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146661 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146664 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146667 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146671 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146674 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146677 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146679 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146682 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146685 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146688 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146690 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146693 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146696 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146699 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146702 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146704 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146707 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 02:43:49.148228 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146710 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146713 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146716 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146718 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146721 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146724 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146726 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146729 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146732 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146734 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146737 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146740 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146742 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146745 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146748 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146750 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146753 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146755 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146759 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146762 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 02:43:49.148726 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146765 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146768 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146771 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146773 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146776 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146779 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146796 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146800 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146803 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146806 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146809 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146811 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146815 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146818 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146820 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146823 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146826 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146829 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146831 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146835 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 02:43:49.149231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146837 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146840 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146843 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146845 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146848 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146850 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146852 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146855 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146858 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146860 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146863 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146866 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146868 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146872 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146874 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146877 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146879 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146882 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146886 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 02:43:49.149716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146890 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146894 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146898 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146901 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146904 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146907 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146911 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146915 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146918 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146921 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146924 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146926 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146929 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146932 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146934 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146937 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146939 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146942 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146944 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 02:43:49.150196 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.146947 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147385 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147391 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147394 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147398 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147401 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147404 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147409 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147412 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147416 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147419 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147423 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147426 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147429 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147431 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147434 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147437 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147440 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147444 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 02:43:49.150660 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147447 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147450 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147453 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147456 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147458 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147461 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147464 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147466 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147469 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147472 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147475 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147479 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147483 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147486 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147489 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147492 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147494 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147497 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147499 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147502 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 02:43:49.151147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147505 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147508 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147510 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147513 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147516 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147519 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147521 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147524 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147526 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147529 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147531 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147534 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147537 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147540 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147542 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147545 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147547 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147550 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147553 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147555 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 02:43:49.151623 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147558 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147560 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147563 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147565 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147568 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147570 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147574 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147577 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147579 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147582 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147584 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147587 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147589 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147592 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147595 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147597 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147600 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147602 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147605 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147608 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 02:43:49.152147 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147610 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147613 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147615 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147618 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147620 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147623 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147625 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147627 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147630 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147632 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147635 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147637 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147640 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147642 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147647 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147650 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147653 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147655 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147658 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147661 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 02:43:49.152645 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.147663 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147740 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147778 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147803 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147808 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147813 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147817 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147822 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147827 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147830 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147833 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147836 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147840 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147843 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147846 2580 flags.go:64] FLAG: --cgroup-root="" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147849 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147852 2580 flags.go:64] FLAG: --client-ca-file="" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147855 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147858 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147862 2580 flags.go:64] FLAG: --cluster-domain="" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147865 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147868 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147871 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147874 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 02:43:49.153149 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147879 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147882 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147887 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147891 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147894 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147897 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147900 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147903 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147906 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147913 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147916 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147919 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147921 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147924 2580 flags.go:64] FLAG: --enable-server="true" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147927 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147933 2580 flags.go:64] FLAG: --event-burst="100" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147937 2580 flags.go:64] FLAG: --event-qps="50" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147940 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147943 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147946 2580 flags.go:64] FLAG: --eviction-hard="" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147950 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147953 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147956 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147959 2580 flags.go:64] FLAG: --eviction-soft="" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147963 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 02:43:49.153718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147966 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147969 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147972 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147975 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147978 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147981 2580 flags.go:64] FLAG: --feature-gates="" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147985 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147988 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147991 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147996 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.147999 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148002 2580 flags.go:64] FLAG: --help="false" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148005 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148008 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148011 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148014 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148019 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148023 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148025 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148028 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148031 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148034 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148037 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148040 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 02:43:49.154369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148044 2580 flags.go:64] FLAG: --kube-reserved="" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148047 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148050 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148053 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148056 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148059 2580 flags.go:64] FLAG: --lock-file="" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148061 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148065 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148068 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148073 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148076 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148079 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148082 2580 flags.go:64] FLAG: --logging-format="text" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148085 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148088 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148091 2580 flags.go:64] FLAG: --manifest-url="" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148094 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148101 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148104 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148109 2580 flags.go:64] FLAG: --max-pods="110" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148111 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148114 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148117 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148120 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148124 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 02:43:49.154981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148128 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148131 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148140 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148143 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148146 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148149 2580 flags.go:64] FLAG: --pod-cidr="" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148152 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148166 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148189 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148193 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148195 2580 flags.go:64] FLAG: --port="10250" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148199 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148202 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a9cea621df48fef" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148205 2580 flags.go:64] FLAG: --qos-reserved="" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148208 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148211 2580 flags.go:64] FLAG: --register-node="true" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148214 2580 flags.go:64] FLAG: --register-with-taints="" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148226 2580 flags.go:64] FLAG: --registry-burst="10" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148229 2580 flags.go:64] FLAG: --registry-qps="5" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148232 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148235 2580 flags.go:64] FLAG: --reserved-memory="" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148239 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148243 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148246 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148249 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 02:43:49.155861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148253 2580 flags.go:64] FLAG: --runonce="false" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148256 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148259 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148263 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148266 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148269 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148273 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148276 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148280 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148282 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148286 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148289 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148291 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148294 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148297 2580 flags.go:64] FLAG: --system-cgroups="" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148300 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148307 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148310 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148313 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148316 2580 flags.go:64] FLAG: --tls-min-version="" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148319 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148322 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148325 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148328 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148331 2580 flags.go:64] FLAG: --v="2" Sep 17 02:43:49.156628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148335 2580 flags.go:64] FLAG: --version="false" Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148339 2580 flags.go:64] FLAG: --vmodule="" Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148343 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.148346 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148463 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148467 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148470 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148474 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148477 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148480 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148482 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148485 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148487 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148491 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148494 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148497 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148499 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148502 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148506 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148510 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 02:43:49.157262 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148513 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148517 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148519 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148523 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148527 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148531 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148534 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148537 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148540 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148543 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148545 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148548 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148550 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148553 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148555 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148558 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148561 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148563 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148566 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 02:43:49.157753 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148569 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148572 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148575 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148577 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148580 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148582 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148586 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148589 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148592 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148594 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148597 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148599 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148602 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148604 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148607 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148610 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148612 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148615 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148619 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148622 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 02:43:49.158234 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148625 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148628 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148631 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148634 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148637 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148639 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148642 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148644 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148647 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148649 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148652 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148654 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148658 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148661 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148663 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148666 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148668 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148671 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148675 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148678 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 02:43:49.158722 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148680 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148683 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148686 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148697 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148699 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148702 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148705 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148707 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148710 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148713 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148715 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148718 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148721 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148724 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148726 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148729 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148731 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148734 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148737 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148740 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 02:43:49.159202 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148743 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148745 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148748 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.148750 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.149178 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.157066 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.157082 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.157103 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.157112 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157171 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157177 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157181 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157184 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157187 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157189 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 02:43:49.159716 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157193 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157198 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157200 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157203 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157206 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157209 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157211 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157214 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157217 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157219 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157222 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157225 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157228 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157230 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157233 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157236 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157239 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157242 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157244 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157248 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 02:43:49.160105 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157251 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157254 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157258 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157261 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157264 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157268 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157271 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157274 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157278 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157281 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157284 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157287 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157290 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157293 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157296 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157299 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157301 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157304 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157307 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 02:43:49.160593 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157310 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157312 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157315 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157318 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157321 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157324 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157326 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157329 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157331 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157334 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157336 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157339 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157341 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157344 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157346 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157349 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157352 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157354 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157357 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 02:43:49.161076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157360 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157363 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157365 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157368 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157370 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157373 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157376 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157378 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157381 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157383 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157386 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157389 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157391 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157394 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157397 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157400 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157403 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157406 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157408 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157411 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 02:43:49.161533 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157414 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157416 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157419 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157422 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157424 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157427 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157429 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157432 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157434 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157438 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157440 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157443 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157445 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157450 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157454 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 02:43:49.162033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.157459 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157583 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157588 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157591 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157594 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157597 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157600 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157603 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157606 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157608 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157611 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157614 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157617 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157619 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157622 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157624 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157627 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157629 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157632 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157634 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 02:43:49.162414 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157638 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157640 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157643 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157645 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157648 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157650 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157653 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157656 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157659 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157661 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157664 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157667 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157670 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157672 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157675 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157678 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157680 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157683 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157685 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 02:43:49.162910 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157688 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157690 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157694 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157696 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157699 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157701 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157704 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157707 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157710 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157712 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157715 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157718 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157722 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157725 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157728 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157730 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157732 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157735 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157738 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 02:43:49.163381 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157741 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157745 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157748 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157751 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157754 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157757 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157760 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157763 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157765 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157768 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157770 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157773 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157776 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157778 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157797 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157800 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157803 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157806 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157808 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 02:43:49.163967 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157811 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157814 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157817 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157820 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157823 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157826 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157830 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157833 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157836 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157839 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157842 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157845 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157848 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157851 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157854 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157857 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157860 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157863 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157865 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157868 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 02:43:49.164432 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157872 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157874 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:49.157877 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.157882 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.158011 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.160934 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.162006 2580 server.go:1019] "Starting client certificate rotation" Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.162107 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.162147 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 02:43:49.164959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.164412 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 02:43:49.168199 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.168175 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 02:43:49.178194 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.178168 2580 log.go:25] "Validated CRI v1 runtime API" Sep 17 02:43:49.181851 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.181834 2580 log.go:25] "Validated CRI v1 image API" Sep 17 02:43:49.183296 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.183282 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 02:43:49.187793 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.187761 2580 fs.go:135] Filesystem UUIDs: map[344a1af6-f8cc-464a-8f4b-8811acf3d3a3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bc484cdd-327a-4b9c-a8f3-2edaee747b5d:/dev/nvme0n1p4] Sep 17 02:43:49.187852 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.187793 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 02:43:49.191316 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.191300 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 02:43:49.193727 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.193618 2580 manager.go:216] Machine: {Timestamp:2026-09-17 02:43:49.192334025 +0000 UTC m=+0.327450359 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099722 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21083c7b0ef7b215e0f9c066fefb9d SystemUUID:ec21083c-7b0e-f7b2-15e0-f9c066fefb9d BootID:de3192f8-e62b-4039-ac69-a258eae514f4 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:2a:9b:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:2a:9b:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:a8:72:12:57:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 02:43:49.193727 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.193720 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 02:43:49.193872 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.193854 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 02:43:49.196972 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.196949 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 02:43:49.197105 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.196974 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 02:43:49.197715 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.197707 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 02:43:49.197745 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.197717 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 02:43:49.197745 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.197724 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 02:43:49.198247 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.198238 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 02:43:49.198944 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.198935 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 02:43:49.202499 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202488 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 17 02:43:49.202619 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202609 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 02:43:49.202659 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202639 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 17 02:43:49.202659 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202648 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 02:43:49.202659 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202658 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 02:43:49.202753 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202668 2580 kubelet.go:398] "Adding apiserver pod source" Sep 17 02:43:49.202753 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.202677 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 02:43:49.203191 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.203163 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 02:43:49.203306 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.203197 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 02:43:49.207214 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.207193 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 02:43:49.209211 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.209195 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 02:43:49.209281 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.209226 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 02:43:49.211218 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211206 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 02:43:49.211273 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211224 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 02:43:49.211273 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211230 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 02:43:49.211273 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211235 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 02:43:49.211273 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211244 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211281 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211296 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211300 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211307 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211312 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211321 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 02:43:49.211380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.211326 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 02:43:49.212617 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.212602 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 02:43:49.212617 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.212615 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 02:43:49.213764 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.213740 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 02:43:49.213850 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.213756 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 02:43:49.216493 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.216481 2580 server.go:1268] "Started kubelet" Sep 17 02:43:49.216671 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.216632 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 02:43:49.216813 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.216614 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 02:43:49.216871 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.216832 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 02:43:49.217298 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.217269 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 02:43:49.217423 ip-10-0-135-174 systemd[1]: Started Kubernetes Kubelet. Sep 17 02:43:49.218695 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.218669 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 02:43:49.219147 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.219035 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 17 02:43:49.221534 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.221504 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 02:43:49.224407 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.224391 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 02:43:49.224511 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.223574 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d5fb917bdb38cd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-17 02:43:49.216434381 +0000 UTC m=+0.351550717,LastTimestamp:2026-09-17 02:43:49.216434381 +0000 UTC m=+0.351550717,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}" Sep 17 02:43:49.224840 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.224823 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 02:43:49.224979 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.224962 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.225388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225321 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 02:43:49.225388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225324 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 02:43:49.225388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225356 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 02:43:49.225565 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225533 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 17 02:43:49.225565 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225552 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 17 02:43:49.225679 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225643 2580 factory.go:55] Registering systemd factory Sep 17 02:43:49.225679 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225660 2580 factory.go:223] Registration of the systemd container factory successfully Sep 17 02:43:49.225914 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225902 2580 factory.go:153] Registering CRI-O factory Sep 17 02:43:49.225914 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225914 2580 factory.go:223] Registration of the crio container factory successfully Sep 17 02:43:49.226027 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225955 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 02:43:49.226027 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225974 2580 factory.go:103] Registering Raw factory Sep 17 02:43:49.226027 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.225984 2580 manager.go:1196] Started watching for new ooms in manager Sep 17 02:43:49.226332 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.226320 2580 manager.go:349] Starting recovery of all containers Sep 17 02:43:49.228514 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.228490 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 02:43:49.228514 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.228493 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 02:43:49.238193 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.238170 2580 manager.go:354] Recovery completed Sep 17 02:43:49.242519 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.242499 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cl8df" Sep 17 02:43:49.242972 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.242959 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.245798 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.245764 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.245857 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.245814 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.245857 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.245828 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.246547 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.246532 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 02:43:49.246547 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.246545 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 02:43:49.246649 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.246563 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 17 02:43:49.246649 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.246546 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.247422 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.247407 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.247518 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.247435 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.247518 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.247447 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.248141 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.248065 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d5fb917d9b42e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-17 02:43:49.245797092 +0000 UTC m=+0.380913428,LastTimestamp:2026-09-17 02:43:49.245797092 +0000 UTC m=+0.380913428,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}" Sep 17 02:43:49.248689 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.248674 2580 policy_none.go:49] "None policy: Start" Sep 17 02:43:49.248689 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.248690 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 02:43:49.248817 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.248700 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 02:43:49.250706 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.250694 2580 policy_none.go:47] "Start" Sep 17 02:43:49.253911 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.253880 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cl8df" Sep 17 02:43:49.259300 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.259222 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d5fb917d9ba377 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-17 02:43:49.245821815 +0000 UTC m=+0.380938150,LastTimestamp:2026-09-17 02:43:49.245821815 +0000 UTC m=+0.380938150,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}" Sep 17 02:43:49.276441 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.276427 2580 manager.go:337] "Starting Device Plugin manager" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.276462 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.276472 2580 server.go:87] "Starting device plugin registration server" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.276745 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.276757 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.276913 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.276997 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.277005 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.277482 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 02:43:49.300052 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.277532 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.318959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.318919 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 02:43:49.320088 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.320073 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 02:43:49.320183 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.320128 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 02:43:49.320183 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.320161 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 02:43:49.320270 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.320207 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 02:43:49.322124 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.322101 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 02:43:49.377023 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.376987 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.378387 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.378369 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.378474 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.378402 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.378474 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.378412 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.378474 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.378434 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.386931 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.386913 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.387044 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.386936 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-174.ec2.internal\": node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.408698 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.408620 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.420716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.420690 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"] Sep 17 02:43:49.420823 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.420779 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.422773 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.422753 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.422882 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.422791 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.422882 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.422803 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.425126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425114 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.425226 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.425269 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425246 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.425878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425854 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.425878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425878 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425889 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46fb29a86827f66e6de753b41a9332bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"46fb29a86827f66e6de753b41a9332bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46fb29a86827f66e6de753b41a9332bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"46fb29a86827f66e6de753b41a9332bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425854 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef1bc5b13e9d8074b0d9ee981b83a940-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"ef1bc5b13e9d8074b0d9ee981b83a940\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425967 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.425987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.425985 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.428803 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.428772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.428881 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.428822 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 02:43:49.429906 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.429887 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory" Sep 17 02:43:49.429906 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.429907 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 02:43:49.430027 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.429916 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID" Sep 17 02:43:49.450483 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.450465 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-174.ec2.internal\" not found" node="ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.454831 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.454816 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-174.ec2.internal\" not found" node="ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.509726 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.509706 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.526605 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.526587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46fb29a86827f66e6de753b41a9332bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"46fb29a86827f66e6de753b41a9332bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.526714 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.526616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46fb29a86827f66e6de753b41a9332bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"46fb29a86827f66e6de753b41a9332bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.526714 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.526641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef1bc5b13e9d8074b0d9ee981b83a940-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"ef1bc5b13e9d8074b0d9ee981b83a940\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.526714 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.526678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef1bc5b13e9d8074b0d9ee981b83a940-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"ef1bc5b13e9d8074b0d9ee981b83a940\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.526714 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.526695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46fb29a86827f66e6de753b41a9332bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"46fb29a86827f66e6de753b41a9332bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.526872 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.526728 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46fb29a86827f66e6de753b41a9332bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"46fb29a86827f66e6de753b41a9332bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.610790 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.610750 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.711592 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.711501 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.752958 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.752932 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.757906 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:49.757769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" Sep 17 02:43:49.812304 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.812148 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:49.912773 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:49.912726 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:50.016036 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:50.015959 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:50.116208 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:50.116170 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:50.161377 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.161348 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 02:43:50.161789 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.161492 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 02:43:50.217128 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:50.217070 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found" Sep 17 02:43:50.250563 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.250534 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 02:43:50.258950 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.258912 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 02:38:49 +0000 UTC" deadline="2028-05-27 10:19:07.004814678 +0000 UTC" Sep 17 02:43:50.258950 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.258948 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14839h35m16.745870867s" Sep 17 02:43:50.326084 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.326030 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" Sep 17 02:43:50.339533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.339512 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 02:43:50.341616 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.341597 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" Sep 17 02:43:50.350779 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.350761 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 02:43:50.457358 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.457328 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 02:43:50.477127 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:50.477082 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1bc5b13e9d8074b0d9ee981b83a940.slice/crio-8c8e85796b91271469de86d383ce55fae7becccb7c0f7c4199231bbdd511c022 WatchSource:0}: Error finding container 8c8e85796b91271469de86d383ce55fae7becccb7c0f7c4199231bbdd511c022: Status 404 returned error can't find the container with id 8c8e85796b91271469de86d383ce55fae7becccb7c0f7c4199231bbdd511c022 Sep 17 02:43:50.477382 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:50.477357 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fb29a86827f66e6de753b41a9332bf.slice/crio-13bbe9b64cb976e4f3dbb024371d0c08c8d2934acd8f70bc9ea5300c3147b817 WatchSource:0}: Error finding container 13bbe9b64cb976e4f3dbb024371d0c08c8d2934acd8f70bc9ea5300c3147b817: Status 404 returned error can't find the container with id 13bbe9b64cb976e4f3dbb024371d0c08c8d2934acd8f70bc9ea5300c3147b817 Sep 17 02:43:50.483001 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.482982 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 02:43:50.732700 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:50.732608 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 02:43:51.204331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.204238 2580 apiserver.go:52] "Watching apiserver" Sep 17 02:43:51.213070 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.213039 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 02:43:51.213514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.213479 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qmq5n","openshift-image-registry/node-ca-gkklv","openshift-multus/multus-additional-cni-plugins-mp7mc","openshift-multus/multus-q4hvp","openshift-network-diagnostics/network-check-target-6k7zp","kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mbcrz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal","openshift-multus/network-metrics-daemon-png44","openshift-network-operator/iptables-alerter-kgwqn","openshift-ovn-kubernetes/ovnkube-node-rsl82","kube-system/global-pull-secret-syncer-l5tbz","kube-system/konnectivity-agent-hg2q9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q"] Sep 17 02:43:51.216238 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.216197 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.218565 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.218542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.219111 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.219088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.219382 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.219360 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rvtbd\"" Sep 17 02:43:51.220141 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.220118 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.221260 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.221229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.222075 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.222043 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 02:43:51.222179 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.222093 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 02:43:51.222250 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.222228 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-frfvv\"" Sep 17 02:43:51.223695 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.223672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.223857 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.223839 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ln5bz\"" Sep 17 02:43:51.225841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.224803 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 02:43:51.225841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.225041 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.225841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.225079 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 02:43:51.225841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.225209 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 02:43:51.225841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.225326 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 02:43:51.225841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.225326 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.226347 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.226288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:51.226412 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.226351 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:43:51.226856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.226693 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 02:43:51.226856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.226756 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rxv88\"" Sep 17 02:43:51.228487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.228466 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.231133 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.231107 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kqd6v\"" Sep 17 02:43:51.231234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.231190 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.231293 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.231265 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:43:51.231355 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.231338 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 02:43:51.231355 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.231343 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.231465 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.231387 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.233422 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.233405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-system-cni-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-multus-certs\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45jsg\" (UniqueName: \"kubernetes.io/projected/29bad9c7-5fa1-49e7-afdf-df2057e1a172-kube-api-access-45jsg\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237136 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysconfig\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-lib-modules\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-system-cni-dir\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-socket-dir-parent\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-cni-multus\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysctl-d\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237350 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33aaf49e-3802-4d05-b321-2b5c5c92e324-agent-certs\") pod \"konnectivity-agent-hg2q9\" (UID: \"33aaf49e-3802-4d05-b321-2b5c5c92e324\") " pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cnibin\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-k8s-cni-cncf-io\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-cni-bin\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.237888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-run\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e140c3d8-477f-4390-9433-ef93f5af4b13-tmp\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237625 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-etc-kubernetes\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-systemd\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-kubelet\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-kubernetes\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46v8q\" (UniqueName: \"kubernetes.io/projected/e140c3d8-477f-4390-9433-ef93f5af4b13-kube-api-access-46v8q\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5mhr\" (UniqueName: \"kubernetes.io/projected/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-kube-api-access-c5mhr\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.237976 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bsbqs\"" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-cni-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-netns\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-hostroot\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-modprobe-d\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysctl-conf\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238215 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-sys\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.238787 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-tuned\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29bad9c7-5fa1-49e7-afdf-df2057e1a172-cni-binary-copy\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-conf-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-var-lib-kubelet\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.238918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-host\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.239057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33aaf49e-3802-4d05-b321-2b5c5c92e324-konnectivity-ca\") pod \"konnectivity-agent-hg2q9\" (UID: \"33aaf49e-3802-4d05-b321-2b5c5c92e324\") " pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.239113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.239165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-cnibin\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.239233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-daemon-config\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.239275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:51.239729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.239454 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.240613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.240375 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.240613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.240408 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-djl8j\"" Sep 17 02:43:51.240613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.240472 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.240613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.240408 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 02:43:51.242178 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.242158 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 02:43:51.242378 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.242357 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bqbc4\"" Sep 17 02:43:51.242533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.242514 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.242619 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.242599 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.242712 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.242585 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.245347 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.245121 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ccmc9\"" Sep 17 02:43:51.245347 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.245190 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 02:43:51.245347 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.245212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.245347 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.245272 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:43:51.245599 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.245562 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 02:43:51.245765 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.245746 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 02:43:51.246542 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.246520 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 02:43:51.246542 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.246539 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 02:43:51.246740 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.246715 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 02:43:51.266509 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.266485 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qhzc6" Sep 17 02:43:51.273841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.273810 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qhzc6" Sep 17 02:43:51.326322 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.326288 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 02:43:51.326683 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.326629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"46fb29a86827f66e6de753b41a9332bf","Type":"ContainerStarted","Data":"13bbe9b64cb976e4f3dbb024371d0c08c8d2934acd8f70bc9ea5300c3147b817"} Sep 17 02:43:51.328280 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.328246 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" event={"ID":"ef1bc5b13e9d8074b0d9ee981b83a940","Type":"ContainerStarted","Data":"8c8e85796b91271469de86d383ce55fae7becccb7c0f7c4199231bbdd511c022"} Sep 17 02:43:51.340497 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-daemon-config\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.340610 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-systemd-units\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.340610 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-env-overrides\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.340610 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340573 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.340610 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-system-cni-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.340841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-multus-certs\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.340841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-run-ovn-kubernetes\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.340841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nvhf\" (UniqueName: \"kubernetes.io/projected/54bd5264-c5a7-4e7b-a25b-03a168dc3759-kube-api-access-4nvhf\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.340841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/273cbf5e-736f-4ef0-bde7-31f77e2a26be-tmp-dir\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.340841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-lib-modules\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-socket-dir-parent\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-etc-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-node-log\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340939 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-system-cni-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.340983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovnkube-config\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/273cbf5e-736f-4ef0-bde7-31f77e2a26be-hosts-file\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysctl-d\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.341086 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33aaf49e-3802-4d05-b321-2b5c5c92e324-agent-certs\") pod \"konnectivity-agent-hg2q9\" (UID: \"33aaf49e-3802-4d05-b321-2b5c5c92e324\") " pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341105 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-lib-modules\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-k8s-cni-cncf-io\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-cni-bin\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e140c3d8-477f-4390-9433-ef93f5af4b13-tmp\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-multus-certs\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-daemon-config\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-run-netns\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e151274c-f201-4606-8c17-0dc492507886-dbus\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-systemd\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-slash\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovn-node-metrics-cert\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e151274c-f201-4606-8c17-0dc492507886-kubelet-config\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwnf\" (UniqueName: \"kubernetes.io/projected/dd9f9c72-022a-4baa-a5fb-b769e8f53654-kube-api-access-gbwnf\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.341609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46v8q\" (UniqueName: \"kubernetes.io/projected/e140c3d8-477f-4390-9433-ef93f5af4b13-kube-api-access-46v8q\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5mhr\" (UniqueName: \"kubernetes.io/projected/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-kube-api-access-c5mhr\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-cni-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-hostroot\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-kubelet\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjpmh\" (UniqueName: \"kubernetes.io/projected/273cbf5e-736f-4ef0-bde7-31f77e2a26be-kube-api-access-gjpmh\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-modprobe-d\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysctl-conf\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-cni-bin\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-sys\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341822 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-k8s-cni-cncf-io\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-socket-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-var-lib-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341884 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd9f9c72-022a-4baa-a5fb-b769e8f53654-iptables-alerter-script\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.341979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-var-lib-kubelet\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.342930 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysctl-d\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-socket-dir-parent\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342229 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342418 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-sys\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342491 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-cni-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysctl-conf\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-hostroot\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-host\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-modprobe-d\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33aaf49e-3802-4d05-b321-2b5c5c92e324-konnectivity-ca\") pod \"konnectivity-agent-hg2q9\" (UID: \"33aaf49e-3802-4d05-b321-2b5c5c92e324\") " pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342826 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-systemd\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-cnibin\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-device-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.342996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-sys-fs\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45jsg\" (UniqueName: \"kubernetes.io/projected/29bad9c7-5fa1-49e7-afdf-df2057e1a172-kube-api-access-45jsg\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.343776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-systemd\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-log-socket\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysconfig\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-system-cni-dir\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-cni-multus\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343216 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-registration-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c405b6c-9d6b-4377-89d7-4242a41c6102-serviceca\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-cni-bin\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-host\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343352 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33aaf49e-3802-4d05-b321-2b5c5c92e324-konnectivity-ca\") pod \"konnectivity-agent-hg2q9\" (UID: \"33aaf49e-3802-4d05-b321-2b5c5c92e324\") " pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-cni-multus\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-system-cni-dir\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343435 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-sysconfig\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-cni-netd\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-cnibin\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cnibin\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.344807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c405b6c-9d6b-4377-89d7-4242a41c6102-host\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-var-lib-kubelet\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cnibin\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-run\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-etc-kubernetes\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343744 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-run\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343773 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-etc-kubernetes\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-ovn\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bpjs\" (UniqueName: \"kubernetes.io/projected/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-kube-api-access-6bpjs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-kubelet\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqj7\" (UniqueName: \"kubernetes.io/projected/714e71ce-e745-4833-b083-924cb983da2e-kube-api-access-6qqj7\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-var-lib-kubelet\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.343973 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd9f9c72-022a-4baa-a5fb-b769e8f53654-host-slash\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-kubernetes\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-netns\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.345684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-kubernetes\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkm6b\" (UniqueName: \"kubernetes.io/projected/5c405b6c-9d6b-4377-89d7-4242a41c6102-kube-api-access-bkm6b\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovnkube-script-lib\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-host-run-netns\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-tuned\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29bad9c7-5fa1-49e7-afdf-df2057e1a172-cni-binary-copy\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-conf-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344393 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29bad9c7-5fa1-49e7-afdf-df2057e1a172-multus-conf-dir\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.346582 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.344789 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29bad9c7-5fa1-49e7-afdf-df2057e1a172-cni-binary-copy\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.348065 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.348012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e140c3d8-477f-4390-9433-ef93f5af4b13-tmp\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.348292 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.348254 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e140c3d8-477f-4390-9433-ef93f5af4b13-etc-tuned\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.348682 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.348655 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33aaf49e-3802-4d05-b321-2b5c5c92e324-agent-certs\") pod \"konnectivity-agent-hg2q9\" (UID: \"33aaf49e-3802-4d05-b321-2b5c5c92e324\") " pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.355521 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.352581 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:43:51.355521 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.352613 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:43:51.355521 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.352626 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:51.355521 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.352706 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:51.852684583 +0000 UTC m=+2.987800931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:51.357535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.357505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45jsg\" (UniqueName: \"kubernetes.io/projected/29bad9c7-5fa1-49e7-afdf-df2057e1a172-kube-api-access-45jsg\") pod \"multus-q4hvp\" (UID: \"29bad9c7-5fa1-49e7-afdf-df2057e1a172\") " pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.358580 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.358554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5mhr\" (UniqueName: \"kubernetes.io/projected/dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d-kube-api-access-c5mhr\") pod \"multus-additional-cni-plugins-mp7mc\" (UID: \"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d\") " pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.359035 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.358975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46v8q\" (UniqueName: \"kubernetes.io/projected/e140c3d8-477f-4390-9433-ef93f5af4b13-kube-api-access-46v8q\") pod \"tuned-mbcrz\" (UID: \"e140c3d8-477f-4390-9433-ef93f5af4b13\") " pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.445279 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-socket-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.445279 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-var-lib-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd9f9c72-022a-4baa-a5fb-b769e8f53654-iptables-alerter-script\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-device-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445373 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-socket-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445373 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-var-lib-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-sys-fs\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445414 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-systemd\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-log-socket\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-registration-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-sys-fs\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.445535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c405b6c-9d6b-4377-89d7-4242a41c6102-serviceca\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-cni-bin\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-device-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-cni-netd\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c405b6c-9d6b-4377-89d7-4242a41c6102-host\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445606 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-systemd\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-ovn\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-log-socket\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bpjs\" (UniqueName: \"kubernetes.io/projected/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-kube-api-access-6bpjs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqj7\" (UniqueName: \"kubernetes.io/projected/714e71ce-e745-4833-b083-924cb983da2e-kube-api-access-6qqj7\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd9f9c72-022a-4baa-a5fb-b769e8f53654-host-slash\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkm6b\" (UniqueName: \"kubernetes.io/projected/5c405b6c-9d6b-4377-89d7-4242a41c6102-kube-api-access-bkm6b\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovnkube-script-lib\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-systemd-units\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-env-overrides\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-run-ovn-kubernetes\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd9f9c72-022a-4baa-a5fb-b769e8f53654-iptables-alerter-script\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445945 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-registration-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.445985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nvhf\" (UniqueName: \"kubernetes.io/projected/54bd5264-c5a7-4e7b-a25b-03a168dc3759-kube-api-access-4nvhf\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/273cbf5e-736f-4ef0-bde7-31f77e2a26be-tmp-dir\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-run-ovn\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-cni-bin\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.446475 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd9f9c72-022a-4baa-a5fb-b769e8f53654-host-slash\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.446558 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:51.946537837 +0000 UTC m=+3.081654170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c405b6c-9d6b-4377-89d7-4242a41c6102-serviceca\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446760 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-systemd-units\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.446886 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-etc-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.446924 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-run-ovn-kubernetes\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.447014 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.447062 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:51.947045615 +0000 UTC m=+3.082161954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-env-overrides\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447138 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/273cbf5e-736f-4ef0-bde7-31f77e2a26be-tmp-dir\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447207 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c405b6c-9d6b-4377-89d7-4242a41c6102-host\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447232 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovnkube-script-lib\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447259 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-cni-netd\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-node-log\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovnkube-config\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-etc-openvswitch\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/273cbf5e-736f-4ef0-bde7-31f77e2a26be-hosts-file\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-node-log\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-run-netns\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.447571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e151274c-f201-4606-8c17-0dc492507886-dbus\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447466 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/273cbf5e-736f-4ef0-bde7-31f77e2a26be-hosts-file\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-slash\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447498 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-slash\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovn-node-metrics-cert\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/714e71ce-e745-4833-b083-924cb983da2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-run-netns\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e151274c-f201-4606-8c17-0dc492507886-kubelet-config\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447586 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e151274c-f201-4606-8c17-0dc492507886-dbus\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e151274c-f201-4606-8c17-0dc492507886-kubelet-config\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwnf\" (UniqueName: \"kubernetes.io/projected/dd9f9c72-022a-4baa-a5fb-b769e8f53654-kube-api-access-gbwnf\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-kubelet\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjpmh\" (UniqueName: \"kubernetes.io/projected/273cbf5e-736f-4ef0-bde7-31f77e2a26be-kube-api-access-gjpmh\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.447967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54bd5264-c5a7-4e7b-a25b-03a168dc3759-host-kubelet\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.448487 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.448108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovnkube-config\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.450366 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.450343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54bd5264-c5a7-4e7b-a25b-03a168dc3759-ovn-node-metrics-cert\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.455078 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.455014 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqj7\" (UniqueName: \"kubernetes.io/projected/714e71ce-e745-4833-b083-924cb983da2e-kube-api-access-6qqj7\") pod \"aws-ebs-csi-driver-node-rxp6q\" (UID: \"714e71ce-e745-4833-b083-924cb983da2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.455505 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.455460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkm6b\" (UniqueName: \"kubernetes.io/projected/5c405b6c-9d6b-4377-89d7-4242a41c6102-kube-api-access-bkm6b\") pod \"node-ca-gkklv\" (UID: \"5c405b6c-9d6b-4377-89d7-4242a41c6102\") " pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.456279 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.456257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjpmh\" (UniqueName: \"kubernetes.io/projected/273cbf5e-736f-4ef0-bde7-31f77e2a26be-kube-api-access-gjpmh\") pod \"node-resolver-qmq5n\" (UID: \"273cbf5e-736f-4ef0-bde7-31f77e2a26be\") " pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.456398 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.456308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nvhf\" (UniqueName: \"kubernetes.io/projected/54bd5264-c5a7-4e7b-a25b-03a168dc3759-kube-api-access-4nvhf\") pod \"ovnkube-node-rsl82\" (UID: \"54bd5264-c5a7-4e7b-a25b-03a168dc3759\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.456815 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.456781 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bpjs\" (UniqueName: \"kubernetes.io/projected/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-kube-api-access-6bpjs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.463275 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.463253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwnf\" (UniqueName: \"kubernetes.io/projected/dd9f9c72-022a-4baa-a5fb-b769e8f53654-kube-api-access-gbwnf\") pod \"iptables-alerter-kgwqn\" (UID: \"dd9f9c72-022a-4baa-a5fb-b769e8f53654\") " pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.531448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.531404 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" Sep 17 02:43:51.542888 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.542854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:43:51.554504 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.554481 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" Sep 17 02:43:51.560734 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.560710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4hvp" Sep 17 02:43:51.569831 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.569749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" Sep 17 02:43:51.577084 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.576927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qmq5n" Sep 17 02:43:51.579338 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.579314 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 02:43:51.584794 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.584775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gkklv" Sep 17 02:43:51.593871 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.593852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kgwqn" Sep 17 02:43:51.600924 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.600902 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:43:51.883691 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.883660 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9f9c72_022a_4baa_a5fb_b769e8f53654.slice/crio-1f4fb8f79addc57975a6fd8b86d4ce63d0dff6d4a37f7b7f0c5d137bfc99ff8f WatchSource:0}: Error finding container 1f4fb8f79addc57975a6fd8b86d4ce63d0dff6d4a37f7b7f0c5d137bfc99ff8f: Status 404 returned error can't find the container with id 1f4fb8f79addc57975a6fd8b86d4ce63d0dff6d4a37f7b7f0c5d137bfc99ff8f Sep 17 02:43:51.885109 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.885084 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9fd7c0_94f4_492f_81aa_2c374e3c1d2d.slice/crio-f906ace8143b6806563d1e9ddb887c1c68cfbf89bacd00c5ea5333028f4f781a WatchSource:0}: Error finding container f906ace8143b6806563d1e9ddb887c1c68cfbf89bacd00c5ea5333028f4f781a: Status 404 returned error can't find the container with id f906ace8143b6806563d1e9ddb887c1c68cfbf89bacd00c5ea5333028f4f781a Sep 17 02:43:51.886852 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.886801 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714e71ce_e745_4833_b083_924cb983da2e.slice/crio-266905fe9ae11f2df50ccd5bf2c7bddff14fbca57160170009e7722d82bc9a20 WatchSource:0}: Error finding container 266905fe9ae11f2df50ccd5bf2c7bddff14fbca57160170009e7722d82bc9a20: Status 404 returned error can't find the container with id 266905fe9ae11f2df50ccd5bf2c7bddff14fbca57160170009e7722d82bc9a20 Sep 17 02:43:51.889531 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.889510 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bad9c7_5fa1_49e7_afdf_df2057e1a172.slice/crio-edfbe34ff3b5435a0311c7ad9a9f806b26b484dec19b4979358984d5cc9fbd89 WatchSource:0}: Error finding container edfbe34ff3b5435a0311c7ad9a9f806b26b484dec19b4979358984d5cc9fbd89: Status 404 returned error can't find the container with id edfbe34ff3b5435a0311c7ad9a9f806b26b484dec19b4979358984d5cc9fbd89 Sep 17 02:43:51.890456 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.890434 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c405b6c_9d6b_4377_89d7_4242a41c6102.slice/crio-aaf94235bf668565ddf20fed07bd723aa43b34110e6163ac5c73ce2df62e5c89 WatchSource:0}: Error finding container aaf94235bf668565ddf20fed07bd723aa43b34110e6163ac5c73ce2df62e5c89: Status 404 returned error can't find the container with id aaf94235bf668565ddf20fed07bd723aa43b34110e6163ac5c73ce2df62e5c89 Sep 17 02:43:51.891112 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.891098 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33aaf49e_3802_4d05_b321_2b5c5c92e324.slice/crio-b2a569323a1eaa4c0d028e91452d3be863c9fa6e2b4de33be718b8d24e7a6585 WatchSource:0}: Error finding container b2a569323a1eaa4c0d028e91452d3be863c9fa6e2b4de33be718b8d24e7a6585: Status 404 returned error can't find the container with id b2a569323a1eaa4c0d028e91452d3be863c9fa6e2b4de33be718b8d24e7a6585 Sep 17 02:43:51.891909 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.891890 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bd5264_c5a7_4e7b_a25b_03a168dc3759.slice/crio-fa3902ae1b387e54f412301917ac8c6e50243cc9fedcbca3ed963885e581476d WatchSource:0}: Error finding container fa3902ae1b387e54f412301917ac8c6e50243cc9fedcbca3ed963885e581476d: Status 404 returned error can't find the container with id fa3902ae1b387e54f412301917ac8c6e50243cc9fedcbca3ed963885e581476d Sep 17 02:43:51.912238 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.912221 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273cbf5e_736f_4ef0_bde7_31f77e2a26be.slice/crio-8d8a93c5df9f733ff7c7ac50213efc7a6acc1511f903b1f45ed8624cb0823618 WatchSource:0}: Error finding container 8d8a93c5df9f733ff7c7ac50213efc7a6acc1511f903b1f45ed8624cb0823618: Status 404 returned error can't find the container with id 8d8a93c5df9f733ff7c7ac50213efc7a6acc1511f903b1f45ed8624cb0823618 Sep 17 02:43:51.913310 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:43:51.913185 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode140c3d8_477f_4390_9433_ef93f5af4b13.slice/crio-ef4feabe0cdf24317d092663c8f0d77b0e94cd033594450fe0953cf8609d3c2e WatchSource:0}: Error finding container ef4feabe0cdf24317d092663c8f0d77b0e94cd033594450fe0953cf8609d3c2e: Status 404 returned error can't find the container with id ef4feabe0cdf24317d092663c8f0d77b0e94cd033594450fe0953cf8609d3c2e Sep 17 02:43:51.951763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.951736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:51.951900 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.951778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:51.951900 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:51.951846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951897 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951936 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951957 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:52.951940811 +0000 UTC m=+4.087057151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951959 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951976 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951983 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:52.951969727 +0000 UTC m=+4.087086065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:51.951997 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.951988 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:51.952244 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:51.952039 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:52.952022991 +0000 UTC m=+4.087139335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:52.277079 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.277001 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 02:38:51 +0000 UTC" deadline="2028-04-12 21:58:24.282268677 +0000 UTC" Sep 17 02:43:52.277079 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.277079 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13771h14m32.005198326s" Sep 17 02:43:52.321444 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.321398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:52.321597 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.321398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:52.321597 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.321536 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:43:52.321597 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.321570 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:43:52.331967 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.331935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4hvp" event={"ID":"29bad9c7-5fa1-49e7-afdf-df2057e1a172","Type":"ContainerStarted","Data":"edfbe34ff3b5435a0311c7ad9a9f806b26b484dec19b4979358984d5cc9fbd89"} Sep 17 02:43:52.333098 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.333059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerStarted","Data":"f906ace8143b6806563d1e9ddb887c1c68cfbf89bacd00c5ea5333028f4f781a"} Sep 17 02:43:52.334282 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.334253 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kgwqn" event={"ID":"dd9f9c72-022a-4baa-a5fb-b769e8f53654","Type":"ContainerStarted","Data":"1f4fb8f79addc57975a6fd8b86d4ce63d0dff6d4a37f7b7f0c5d137bfc99ff8f"} Sep 17 02:43:52.335492 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.335469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qmq5n" event={"ID":"273cbf5e-736f-4ef0-bde7-31f77e2a26be","Type":"ContainerStarted","Data":"8d8a93c5df9f733ff7c7ac50213efc7a6acc1511f903b1f45ed8624cb0823618"} Sep 17 02:43:52.336654 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.336630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" event={"ID":"714e71ce-e745-4833-b083-924cb983da2e","Type":"ContainerStarted","Data":"266905fe9ae11f2df50ccd5bf2c7bddff14fbca57160170009e7722d82bc9a20"} Sep 17 02:43:52.338550 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.338528 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"46fb29a86827f66e6de753b41a9332bf","Type":"ContainerStarted","Data":"3d73e3b98b08f5b9dbe3f400e1c2f1b78bb168d26e917f038a8f4355a2bc3e33"} Sep 17 02:43:52.339648 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.339623 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" event={"ID":"e140c3d8-477f-4390-9433-ef93f5af4b13","Type":"ContainerStarted","Data":"ef4feabe0cdf24317d092663c8f0d77b0e94cd033594450fe0953cf8609d3c2e"} Sep 17 02:43:52.340836 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.340813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"fa3902ae1b387e54f412301917ac8c6e50243cc9fedcbca3ed963885e581476d"} Sep 17 02:43:52.341983 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.341954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hg2q9" event={"ID":"33aaf49e-3802-4d05-b321-2b5c5c92e324","Type":"ContainerStarted","Data":"b2a569323a1eaa4c0d028e91452d3be863c9fa6e2b4de33be718b8d24e7a6585"} Sep 17 02:43:52.343269 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.343243 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gkklv" event={"ID":"5c405b6c-9d6b-4377-89d7-4242a41c6102","Type":"ContainerStarted","Data":"aaf94235bf668565ddf20fed07bd723aa43b34110e6163ac5c73ce2df62e5c89"} Sep 17 02:43:52.958880 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.958840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:52.959074 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.958910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:52.959074 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:52.958946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:52.959074 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959071 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:52.959237 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959134 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:54.959115406 +0000 UTC m=+6.094231732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:52.959560 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959540 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:43:52.959644 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959567 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:43:52.959644 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959580 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:52.959644 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959624 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:54.959609663 +0000 UTC m=+6.094725990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:52.959811 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959686 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:52.959811 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:52.959715 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:54.959705124 +0000 UTC m=+6.094821448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:53.277411 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.277367 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 02:38:51 +0000 UTC" deadline="2028-05-24 09:22:36.797283358 +0000 UTC" Sep 17 02:43:53.277411 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.277410 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14766h38m43.519878133s" Sep 17 02:43:53.323065 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.321070 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:53.323065 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:53.321214 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:43:53.349112 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.349073 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" event={"ID":"ef1bc5b13e9d8074b0d9ee981b83a940","Type":"ContainerStarted","Data":"519a2a590584e0d3ba1f5478e3b39ccfc0096db145c365f8e577b96e42136932"} Sep 17 02:43:53.359514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.359476 2580 generic.go:356] "Generic (PLEG): container finished" podID="46fb29a86827f66e6de753b41a9332bf" containerID="3d73e3b98b08f5b9dbe3f400e1c2f1b78bb168d26e917f038a8f4355a2bc3e33" exitCode=0 Sep 17 02:43:53.359661 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.359520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"46fb29a86827f66e6de753b41a9332bf","Type":"ContainerDied","Data":"3d73e3b98b08f5b9dbe3f400e1c2f1b78bb168d26e917f038a8f4355a2bc3e33"} Sep 17 02:43:53.381697 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:53.381582 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" podStartSLOduration=3.381563005 podStartE2EDuration="3.381563005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:43:53.364839416 +0000 UTC m=+4.499955763" watchObservedRunningTime="2026-09-17 02:43:53.381563005 +0000 UTC m=+4.516679351" Sep 17 02:43:54.321535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:54.321317 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:54.322025 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.321659 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:43:54.322025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:54.321991 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:54.322137 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.322082 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:43:54.390370 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:54.390311 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"46fb29a86827f66e6de753b41a9332bf","Type":"ContainerStarted","Data":"83edc6b478ad95df3030efcfddd869d49f79387d15247f2deb7e149670ee3081"} Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:54.975904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:54.975962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:54.975997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976108 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976135 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976149 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976172 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976207 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:58.976188745 +0000 UTC m=+10.111305095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:54.976230 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976227 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:58.976217707 +0000 UTC m=+10.111334042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:54.976880 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976118 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:54.976880 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:54.976576 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:43:58.976561703 +0000 UTC m=+10.111678037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:55.320923 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:55.320842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:55.321085 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:55.320988 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:43:56.321717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:56.321022 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:56.321717 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:56.321153 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:43:56.321717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:56.321516 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:56.321717 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:56.321622 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:43:57.321561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:57.321530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:57.321740 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:57.321663 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:43:58.321380 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:58.321301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:58.321536 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:58.321442 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:43:58.321536 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:58.321504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:58.321659 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:58.321641 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:43:59.012060 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:59.012026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:59.012075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:59.012140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012218 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012258 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012275 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012292 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012301 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012304 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:07.012281869 +0000 UTC m=+18.147398236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012325 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:07.012315178 +0000 UTC m=+18.147431505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:43:59.012533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.012340 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:07.012331393 +0000 UTC m=+18.147447718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:43:59.321927 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:43:59.321461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:43:59.321927 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:43:59.321567 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:00.320523 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:00.320491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:00.321024 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:00.320610 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:00.321024 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:00.320952 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:00.321135 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:00.321028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:01.321295 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:01.321263 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:01.321746 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:01.321371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:02.320589 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:02.320552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:02.320753 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:02.320563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:02.320753 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:02.320703 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:02.320875 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:02.320804 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:03.320747 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:03.320712 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:03.321152 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:03.320842 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:04.321315 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:04.321284 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:04.321315 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:04.321310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:04.321772 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:04.321401 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:04.321772 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:04.321498 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:05.321308 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:05.321277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:05.321478 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:05.321387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:06.320846 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:06.320797 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:06.321039 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:06.320849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:06.321039 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:06.320952 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:06.321132 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:06.321063 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:07.069310 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:07.069279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:07.069319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:07.069370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069431 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069467 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069484 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069494 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:23.069475329 +0000 UTC m=+34.204591655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069495 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069512 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069531 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:23.069522262 +0000 UTC m=+34.204638584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:44:07.069700 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.069574 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:23.069555601 +0000 UTC m=+34.204671928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:44:07.321049 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:07.320969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:07.321197 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:07.321097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:08.321294 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:08.321264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:08.321294 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:08.321290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:08.321709 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:08.321382 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:08.321709 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:08.321495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:09.324363 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:09.324335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:09.324824 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:09.324492 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:10.320878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.320644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:10.320969 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.320673 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:10.321011 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:10.320988 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:10.321099 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:10.321078 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:10.428776 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.428549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hg2q9" event={"ID":"33aaf49e-3802-4d05-b321-2b5c5c92e324","Type":"ContainerStarted","Data":"074d984a4a29aba36eb38456603ed40351543a32c0b2ad12822dc650b218916b"} Sep 17 02:44:10.430367 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.430337 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gkklv" event={"ID":"5c405b6c-9d6b-4377-89d7-4242a41c6102","Type":"ContainerStarted","Data":"7749471ed5fe9639eddb6de0a77e0370e07e802dc2116dde9230518d1c929e53"} Sep 17 02:44:10.431987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.431959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4hvp" event={"ID":"29bad9c7-5fa1-49e7-afdf-df2057e1a172","Type":"ContainerStarted","Data":"e6709aa5c1650d27e8a1e2733c5fa32178c34b87a66cb017191a3214ec32ed8b"} Sep 17 02:44:10.433368 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.433346 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d" containerID="c87a5044ca854152e92dbe2cbdbc83abb158122999c2ded9a8d556bc04a8f36c" exitCode=0 Sep 17 02:44:10.433474 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.433404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerDied","Data":"c87a5044ca854152e92dbe2cbdbc83abb158122999c2ded9a8d556bc04a8f36c"} Sep 17 02:44:10.435005 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.434918 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qmq5n" event={"ID":"273cbf5e-736f-4ef0-bde7-31f77e2a26be","Type":"ContainerStarted","Data":"840aace9b4be3c2e2ccc5530b2fa8271fb25a4055655280b4ede678cefad9806"} Sep 17 02:44:10.436409 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.436382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" event={"ID":"714e71ce-e745-4833-b083-924cb983da2e","Type":"ContainerStarted","Data":"3c39aa1c2525ba6e6d1effe7b037bfa19d1264b3cc170ed79fa4c694c79302c4"} Sep 17 02:44:10.438280 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.438251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" event={"ID":"e140c3d8-477f-4390-9433-ef93f5af4b13","Type":"ContainerStarted","Data":"1be3713b644a04a888258b1d14b516f6f99fd0775a7dd3692692f9d014659102"} Sep 17 02:44:10.441095 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.441071 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:44:10.441480 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.441457 2580 generic.go:356] "Generic (PLEG): container finished" podID="54bd5264-c5a7-4e7b-a25b-03a168dc3759" containerID="f70d6a59a294b2897dd8c83ef30a663025f40678edf2ae555f78b431e878fa41" exitCode=1 Sep 17 02:44:10.441539 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.441496 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"8c18e94e8261bae022ee4dfcdf114ed7dc59d7d54e42546a97c3b5cfd6329626"} Sep 17 02:44:10.441584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.441569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerDied","Data":"f70d6a59a294b2897dd8c83ef30a663025f40678edf2ae555f78b431e878fa41"} Sep 17 02:44:10.441641 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.441628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"8ef3ecee83e6668768c3333c0ee397b483112d3ca151c0b151272e877ceb9162"} Sep 17 02:44:10.443417 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.443360 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" podStartSLOduration=20.443343504 podStartE2EDuration="20.443343504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:43:54.406052943 +0000 UTC m=+5.541169288" watchObservedRunningTime="2026-09-17 02:44:10.443343504 +0000 UTC m=+21.578459849" Sep 17 02:44:10.444044 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.444000 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hg2q9" podStartSLOduration=10.849766307 podStartE2EDuration="21.44398591s" totalImagesPullingTime="10.594219603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:10.442418663 +0000 UTC m=+21.577535009" watchObservedRunningTime="2026-09-17 02:44:10.44398591 +0000 UTC m=+21.579102255" Sep 17 02:44:10.457729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.457691 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mbcrz" podStartSLOduration=3.3488412260000002 podStartE2EDuration="21.457678845s" totalImagesPullingTime="18.108837619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:10.457343698 +0000 UTC m=+21.592460045" watchObservedRunningTime="2026-09-17 02:44:10.457678845 +0000 UTC m=+21.592795189" Sep 17 02:44:10.498134 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.498077 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gkklv" podStartSLOduration=3.386712005 podStartE2EDuration="21.498054604s" totalImagesPullingTime="18.111342599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:10.470132089 +0000 UTC m=+21.605248432" watchObservedRunningTime="2026-09-17 02:44:10.498054604 +0000 UTC m=+21.633171018" Sep 17 02:44:10.516962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.516920 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q4hvp" podStartSLOduration=3.171542833 podStartE2EDuration="21.516903171s" totalImagesPullingTime="18.345360338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:10.51662966 +0000 UTC m=+21.651746008" watchObservedRunningTime="2026-09-17 02:44:10.516903171 +0000 UTC m=+21.652019515" Sep 17 02:44:10.530094 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:10.530055 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qmq5n" podStartSLOduration=3.438331953 podStartE2EDuration="21.53003945s" totalImagesPullingTime="18.091707497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:10.530002689 +0000 UTC m=+21.665119033" watchObservedRunningTime="2026-09-17 02:44:10.53003945 +0000 UTC m=+21.665155794" Sep 17 02:44:11.040817 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.040731 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:44:11.041696 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.041672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:44:11.321180 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.321114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:11.321311 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:11.321215 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:11.449575 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.449555 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:44:11.449950 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.449904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"2cc4a3c8aca1edf369e1f35e6b33dd2793c1a72a9d9e15bfccb3739990107940"} Sep 17 02:44:11.450015 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.449979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"3e0ceba532724c877fdd4614647cc48d3e0a67d63fff8a558c4ae0c9a067ff92"} Sep 17 02:44:11.450060 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.450022 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"30d37e048209a1fad58ec63ccc090af5640605694e15da163d6f5baf0c53fd70"} Sep 17 02:44:11.618211 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.618184 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 02:44:11.731533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.731499 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:44:11.732156 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:11.732132 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hg2q9" Sep 17 02:44:12.288267 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.288152 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T02:44:11.618206364Z","UUID":"2738e933-4682-4700-91fd-d9efa445848d","Handler":null,"Name":"","Endpoint":""} Sep 17 02:44:12.290771 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.290736 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 02:44:12.290978 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.290800 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 02:44:12.321202 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.321175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:12.321202 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.321201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:12.321381 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:12.321291 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:12.321426 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:12.321400 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:12.454105 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.454069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" event={"ID":"714e71ce-e745-4833-b083-924cb983da2e","Type":"ContainerStarted","Data":"41eb2bd179effce0527eeeff67714ed5f1917ab12f5c2698d35f93277c64a6b0"} Sep 17 02:44:12.455723 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.455697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kgwqn" event={"ID":"dd9f9c72-022a-4baa-a5fb-b769e8f53654","Type":"ContainerStarted","Data":"be29dda5b17a6dd5f878597b8fc1f37b36c0450b4ee9781a99716d084164096d"} Sep 17 02:44:12.494943 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:12.494899 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kgwqn" podStartSLOduration=5.359286482 podStartE2EDuration="23.494883829s" totalImagesPullingTime="18.135597347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:12.494818066 +0000 UTC m=+23.629934410" watchObservedRunningTime="2026-09-17 02:44:12.494883829 +0000 UTC m=+23.630000173" Sep 17 02:44:13.321259 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:13.321226 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:13.321497 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:13.321362 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:13.460609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:13.460575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" event={"ID":"714e71ce-e745-4833-b083-924cb983da2e","Type":"ContainerStarted","Data":"9e10761440d03271ef120369b37a68dd7d6338f2b1391d13d5d9a39d587657dd"} Sep 17 02:44:13.464216 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:13.464194 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:44:13.464743 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:13.464697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"aa37ce888e198afa80c33f2111dbc2b73a070f40d83c43088d7f97230fe2b7db"} Sep 17 02:44:13.479871 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:13.479822 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxp6q" podStartSLOduration=4.060341994 podStartE2EDuration="24.479804676s" totalImagesPullingTime="20.419462682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:13.479129731 +0000 UTC m=+24.614246075" watchObservedRunningTime="2026-09-17 02:44:13.479804676 +0000 UTC m=+24.614921020" Sep 17 02:44:14.320649 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:14.320619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:14.320847 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:14.320740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:14.320847 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:14.320808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:14.320970 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:14.320916 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:15.321025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.320866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:15.321724 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:15.321119 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:15.476378 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.476352 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:44:15.476745 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.476713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"ea8eb9cefc0d0834c1a99b64d8891b63599a81b3b6a6b1b363089fad4aa3c2ce"} Sep 17 02:44:15.477052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.476962 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:44:15.477174 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.477147 2580 scope.go:117] "RemoveContainer" containerID="f70d6a59a294b2897dd8c83ef30a663025f40678edf2ae555f78b431e878fa41" Sep 17 02:44:15.478745 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.478723 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d" containerID="700b22cb3363fd02720d60f5584d1b2be6a6ff40091041ac62c217b2b37f5621" exitCode=0 Sep 17 02:44:15.478884 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.478758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerDied","Data":"700b22cb3363fd02720d60f5584d1b2be6a6ff40091041ac62c217b2b37f5621"} Sep 17 02:44:15.493418 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:15.493399 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:44:16.320716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.320455 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:16.320999 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:16.320836 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:16.320999 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.320608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:16.320999 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:16.320928 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:16.485215 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.485172 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:44:16.485672 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.485642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" event={"ID":"54bd5264-c5a7-4e7b-a25b-03a168dc3759","Type":"ContainerStarted","Data":"00554282eba2bfe0793a2f87681367b0b5d38958b3d924eef24183d1bc0b9b42"} Sep 17 02:44:16.485976 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.485948 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:44:16.486077 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.486039 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:44:16.500102 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.500079 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:44:16.512901 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.512861 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" podStartSLOduration=9.379193989000001 podStartE2EDuration="27.512847936s" totalImagesPullingTime="18.133653947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:16.511058714 +0000 UTC m=+27.646175058" watchObservedRunningTime="2026-09-17 02:44:16.512847936 +0000 UTC m=+27.647964285" Sep 17 02:44:16.915219 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.915151 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5tbz"] Sep 17 02:44:16.915351 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.915264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:16.915407 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:16.915379 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:16.918544 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.918519 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-png44"] Sep 17 02:44:16.918692 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.918609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:16.918742 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:16.918702 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:16.919351 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.919330 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6k7zp"] Sep 17 02:44:16.919444 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:16.919394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:16.919533 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:16.919463 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:17.490360 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:17.490323 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d" containerID="4904eb2e54a714012d5c0079442f781a893bd93ae4841f5888b9e6f6cdcaad2b" exitCode=0 Sep 17 02:44:17.490718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:17.490393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerDied","Data":"4904eb2e54a714012d5c0079442f781a893bd93ae4841f5888b9e6f6cdcaad2b"} Sep 17 02:44:18.321012 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:18.320981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:18.321166 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:18.320984 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:18.321166 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:18.321093 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:18.321166 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:18.321107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:18.321278 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:18.321165 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:18.321278 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:18.321233 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:19.496822 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:19.496770 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d" containerID="0bf1d827f3db496dff1d6d68a4c89490b9abe418f23628a7f2f9854f571e10dc" exitCode=0 Sep 17 02:44:19.496822 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:19.496818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerDied","Data":"0bf1d827f3db496dff1d6d68a4c89490b9abe418f23628a7f2f9854f571e10dc"} Sep 17 02:44:20.320833 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:20.320799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:20.320833 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:20.320829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:20.321081 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:20.320816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:20.321081 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:20.320915 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:20.321081 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:20.320991 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:20.321206 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:20.321078 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:22.320440 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:22.320414 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:22.320803 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:22.320414 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:22.320803 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:22.320515 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:44:22.320803 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:22.320414 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:22.320803 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:22.320575 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5tbz" podUID="e151274c-f201-4606-8c17-0dc492507886" Sep 17 02:44:22.320803 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:22.320635 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6k7zp" podUID="b61bcaa3-28d6-4fcb-97f7-7f9384263d15" Sep 17 02:44:23.081660 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.081445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.081706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081605 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.081744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081850 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081860 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081872 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081890 2580 projected.go:196] Error preparing data for projected volume kube-api-access-nslvk for pod openshift-network-diagnostics/network-check-target-6k7zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:44:23.081923 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081853 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret podName:e151274c-f201-4606-8c17-0dc492507886 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:55.081836143 +0000 UTC m=+66.216952470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret") pod "global-pull-secret-syncer-l5tbz" (UID: "e151274c-f201-4606-8c17-0dc492507886") : object "kube-system"/"original-pull-secret" not registered Sep 17 02:44:23.082244 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081952 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:55.081934639 +0000 UTC m=+66.217050975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 02:44:23.082244 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.081968 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk podName:b61bcaa3-28d6-4fcb-97f7-7f9384263d15 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:55.081959332 +0000 UTC m=+66.217075661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nslvk" (UniqueName: "kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk") pod "network-check-target-6k7zp" (UID: "b61bcaa3-28d6-4fcb-97f7-7f9384263d15") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 02:44:23.111725 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.111693 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeReady" Sep 17 02:44:23.111907 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.111877 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 02:44:23.146227 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.146190 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf"] Sep 17 02:44:23.174649 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.174617 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8648ff99b-tz2hs"] Sep 17 02:44:23.174840 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.174752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.179052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.177987 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tbj68\"" Sep 17 02:44:23.179052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.178298 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 02:44:23.179052 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.178491 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 02:44:23.190510 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.190484 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf"] Sep 17 02:44:23.190626 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.190529 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pcsrp"] Sep 17 02:44:23.190626 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.190618 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.193441 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.193417 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 02:44:23.193546 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.193461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 02:44:23.193546 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.193525 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 02:44:23.193667 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.193550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wcv2b\"" Sep 17 02:44:23.200021 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.199961 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 02:44:23.208877 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.208859 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-npb4m"] Sep 17 02:44:23.208989 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.208969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.212235 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.212217 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 02:44:23.212333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.212219 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 02:44:23.212333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.212219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cm2j6\"" Sep 17 02:44:23.234867 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.234847 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8648ff99b-tz2hs"] Sep 17 02:44:23.234984 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.234882 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-npb4m"] Sep 17 02:44:23.234984 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.234901 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pcsrp"] Sep 17 02:44:23.235081 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.234992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.238868 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.238849 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 02:44:23.239004 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.238870 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 02:44:23.239004 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.238875 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 02:44:23.239162 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.239141 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tczxm\"" Sep 17 02:44:23.282571 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-installation-pull-secrets\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.282728 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-image-registry-private-configuration\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.282728 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.282728 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f3c5a47-09c3-401c-8aac-30d325331c99-config-volume\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.282728 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfvhh\" (UniqueName: \"kubernetes.io/projected/5f3c5a47-09c3-401c-8aac-30d325331c99-kube-api-access-sfvhh\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.282928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.282928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-trusted-ca\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.282928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-certificates\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.282928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7w49\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-kube-api-access-q7w49\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.282928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92801ed5-a854-46b7-8821-9a0a952ded5a-ca-trust-extracted\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.283151 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-bound-sa-token\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.283151 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.282983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.283151 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.283010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e3aad2f-5f5c-443f-8ef6-3295344373ca-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.283151 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.283035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f3c5a47-09c3-401c-8aac-30d325331c99-tmp-dir\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.383580 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92801ed5-a854-46b7-8821-9a0a952ded5a-ca-trust-extracted\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.383580 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-bound-sa-token\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.383580 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e3aad2f-5f5c-443f-8ef6-3295344373ca-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f3c5a47-09c3-401c-8aac-30d325331c99-tmp-dir\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191ed4a8-cff5-43e6-9b83-a9fb15d4846d-cert\") pod \"ingress-canary-npb4m\" (UID: \"191ed4a8-cff5-43e6-9b83-a9fb15d4846d\") " pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.383750 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.383833 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:23.883811708 +0000 UTC m=+35.018928039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-installation-pull-secrets\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92801ed5-a854-46b7-8821-9a0a952ded5a-ca-trust-extracted\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.383980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-722ll\" (UniqueName: \"kubernetes.io/projected/191ed4a8-cff5-43e6-9b83-a9fb15d4846d-kube-api-access-722ll\") pod \"ingress-canary-npb4m\" (UID: \"191ed4a8-cff5-43e6-9b83-a9fb15d4846d\") " pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-image-registry-private-configuration\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384102 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f3c5a47-09c3-401c-8aac-30d325331c99-tmp-dir\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.384143 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f3c5a47-09c3-401c-8aac-30d325331c99-config-volume\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfvhh\" (UniqueName: \"kubernetes.io/projected/5f3c5a47-09c3-401c-8aac-30d325331c99-kube-api-access-sfvhh\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.384240 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.384256 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.384310 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384312 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e3aad2f-5f5c-443f-8ef6-3295344373ca-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.384314 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:44:23.884295985 +0000 UTC m=+35.019412308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.384367 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:44:23.884353277 +0000 UTC m=+35.019469605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-trusted-ca\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-certificates\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.384638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7w49\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-kube-api-access-q7w49\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.385127 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.384837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f3c5a47-09c3-401c-8aac-30d325331c99-config-volume\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.385187 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.385143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-certificates\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.385375 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.385355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-trusted-ca\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.389051 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.389024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-image-registry-private-configuration\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.389166 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.389057 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-installation-pull-secrets\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.392536 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.392512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-bound-sa-token\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.392652 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.392573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfvhh\" (UniqueName: \"kubernetes.io/projected/5f3c5a47-09c3-401c-8aac-30d325331c99-kube-api-access-sfvhh\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.393070 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.393053 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7w49\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-kube-api-access-q7w49\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.485318 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.485287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191ed4a8-cff5-43e6-9b83-a9fb15d4846d-cert\") pod \"ingress-canary-npb4m\" (UID: \"191ed4a8-cff5-43e6-9b83-a9fb15d4846d\") " pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.485493 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.485345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-722ll\" (UniqueName: \"kubernetes.io/projected/191ed4a8-cff5-43e6-9b83-a9fb15d4846d-kube-api-access-722ll\") pod \"ingress-canary-npb4m\" (UID: \"191ed4a8-cff5-43e6-9b83-a9fb15d4846d\") " pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.488104 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.488079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191ed4a8-cff5-43e6-9b83-a9fb15d4846d-cert\") pod \"ingress-canary-npb4m\" (UID: \"191ed4a8-cff5-43e6-9b83-a9fb15d4846d\") " pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.493543 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.493519 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-722ll\" (UniqueName: \"kubernetes.io/projected/191ed4a8-cff5-43e6-9b83-a9fb15d4846d-kube-api-access-722ll\") pod \"ingress-canary-npb4m\" (UID: \"191ed4a8-cff5-43e6-9b83-a9fb15d4846d\") " pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.545552 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.545498 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-npb4m" Sep 17 02:44:23.887421 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.887369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:23.887601 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.887448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:23.887601 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:23.887478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:23.887601 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887556 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:23.887601 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887570 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:23.887601 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887586 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:23.887601 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887603 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:23.887875 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887625 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:44:24.887610979 +0000 UTC m=+36.022727301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:23.887875 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887637 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:24.887631452 +0000 UTC m=+36.022747774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:23.887875 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:23.887648 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:44:24.887642748 +0000 UTC m=+36.022759069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:24.206123 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.206045 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-npb4m"] Sep 17 02:44:24.208971 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:44:24.208949 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191ed4a8_cff5_43e6_9b83_a9fb15d4846d.slice/crio-91828640a877874cfa28239f29e77a8b64f08c4592eed2b7f9c05a52b64e29a5 WatchSource:0}: Error finding container 91828640a877874cfa28239f29e77a8b64f08c4592eed2b7f9c05a52b64e29a5: Status 404 returned error can't find the container with id 91828640a877874cfa28239f29e77a8b64f08c4592eed2b7f9c05a52b64e29a5 Sep 17 02:44:24.321093 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.321052 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:24.321093 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.321073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:24.321251 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.321051 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:24.324924 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.324703 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 02:44:24.324924 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.324722 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2v2l\"" Sep 17 02:44:24.324924 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.324726 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 02:44:24.325955 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.325927 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-742gf\"" Sep 17 02:44:24.326074 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.326000 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 02:44:24.326163 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.326091 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 02:44:24.510515 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.510428 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d" containerID="dd12975f3851f7b589213f898eb3a02812a7a6f19402f89199c44748c7bf43ee" exitCode=0 Sep 17 02:44:24.511459 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.510513 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerDied","Data":"dd12975f3851f7b589213f898eb3a02812a7a6f19402f89199c44748c7bf43ee"} Sep 17 02:44:24.511771 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.511748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-npb4m" event={"ID":"191ed4a8-cff5-43e6-9b83-a9fb15d4846d","Type":"ContainerStarted","Data":"91828640a877874cfa28239f29e77a8b64f08c4592eed2b7f9c05a52b64e29a5"} Sep 17 02:44:24.897382 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.897226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:24.897382 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.897271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:24.897382 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:24.897331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897389 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897406 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897415 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897465 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:26.897448566 +0000 UTC m=+38.032564892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897464 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897487 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:44:26.897476677 +0000 UTC m=+38.032593016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:24.897730 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:24.897536 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:44:26.89751769 +0000 UTC m=+38.032634019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:25.517059 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:25.516830 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d" containerID="e7b54cfd3e45bf6311eae45de7ee4bb3838c43625d29085e4efdf7879c874f6e" exitCode=0 Sep 17 02:44:25.517059 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:25.516918 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerDied","Data":"e7b54cfd3e45bf6311eae45de7ee4bb3838c43625d29085e4efdf7879c874f6e"} Sep 17 02:44:26.524145 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:26.524063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" event={"ID":"dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d","Type":"ContainerStarted","Data":"992f700f4b561bac7d5a18b8cfa437d25d70a7b658096b4f20a42247298c1790"} Sep 17 02:44:26.547944 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:26.547884 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mp7mc" podStartSLOduration=7.728133491 podStartE2EDuration="37.547863057s" totalImagesPullingTime="29.819729566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:26.546021943 +0000 UTC m=+37.681138299" watchObservedRunningTime="2026-09-17 02:44:26.547863057 +0000 UTC m=+37.682979401" Sep 17 02:44:26.913078 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:26.913047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:26.913154 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:26.913114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:26.913187 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:26.913157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:26.913241 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913220 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:26.913276 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913243 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:26.913276 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913254 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:26.913276 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913256 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:26.913367 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913295 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:44:30.91327859 +0000 UTC m=+42.048394932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:26.913367 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913311 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:44:30.913304029 +0000 UTC m=+42.048420350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:26.913367 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:26.913320 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:30.913315573 +0000 UTC m=+42.048431895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:27.527596 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:27.527544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-npb4m" event={"ID":"191ed4a8-cff5-43e6-9b83-a9fb15d4846d","Type":"ContainerStarted","Data":"b412cdb03b5ccb5b32defb16a6bbe2baa9f78a6f546db4bde448c6fcf6834457"} Sep 17 02:44:27.545339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:27.545288 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-npb4m" podStartSLOduration=2.144290411 podStartE2EDuration="4.545275151s" totalImagesPullingTime="2.40098474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:44:27.544564468 +0000 UTC m=+38.679680812" watchObservedRunningTime="2026-09-17 02:44:27.545275151 +0000 UTC m=+38.680391495" Sep 17 02:44:30.943054 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:30.943016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:30.943076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943174 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943189 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943199 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:30.943217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943245 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:44:38.943227995 +0000 UTC m=+50.078344330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943295 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943310 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:38.943279262 +0000 UTC m=+50.078395588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:30.943445 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:30.943334 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:44:38.943326543 +0000 UTC m=+50.078442865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:39.006348 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:39.006306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:39.006370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:39.006404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006484 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006486 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006505 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006520 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006536 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:44:55.006523297 +0000 UTC m=+66.141639619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006549 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:44:55.006542135 +0000 UTC m=+66.141658458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:39.006904 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:39.006568 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:44:55.006554818 +0000 UTC m=+66.141671140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:48.506916 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:48.506887 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsl82" Sep 17 02:44:55.024613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.024573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:44:55.024613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.024620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.024668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024736 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024752 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024758 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024816 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:45:27.02480222 +0000 UTC m=+98.159918554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024836 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:45:27.02482189 +0000 UTC m=+98.159938212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024861 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:44:55.025154 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.024923 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:45:27.024911815 +0000 UTC m=+98.160028141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:44:55.125248 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.125213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:55.125454 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.125272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:44:55.125454 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.125317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:55.127943 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.127917 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 02:44:55.128022 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.128006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 02:44:55.128073 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.128039 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 02:44:55.136033 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.136015 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 02:44:55.136090 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:44:55.136080 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:45:59.136064943 +0000 UTC m=+130.271181265 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : secret "metrics-daemon-secret" not found Sep 17 02:44:55.138167 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.138148 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 02:44:55.139170 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.139151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e151274c-f201-4606-8c17-0dc492507886-original-pull-secret\") pod \"global-pull-secret-syncer-l5tbz\" (UID: \"e151274c-f201-4606-8c17-0dc492507886\") " pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:55.148084 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.148065 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nslvk\" (UniqueName: \"kubernetes.io/projected/b61bcaa3-28d6-4fcb-97f7-7f9384263d15-kube-api-access-nslvk\") pod \"network-check-target-6k7zp\" (UID: \"b61bcaa3-28d6-4fcb-97f7-7f9384263d15\") " pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:55.244029 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.244004 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2v2l\"" Sep 17 02:44:55.246015 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.245998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5tbz" Sep 17 02:44:55.252161 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.252147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:44:55.535186 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.535082 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5tbz"] Sep 17 02:44:55.537490 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:44:55.537469 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode151274c_f201_4606_8c17_0dc492507886.slice/crio-4031dfdc9deb6ecba2ac0fb7e14b9a9d8595d3768b6913ef16e88594ac9d31b9 WatchSource:0}: Error finding container 4031dfdc9deb6ecba2ac0fb7e14b9a9d8595d3768b6913ef16e88594ac9d31b9: Status 404 returned error can't find the container with id 4031dfdc9deb6ecba2ac0fb7e14b9a9d8595d3768b6913ef16e88594ac9d31b9 Sep 17 02:44:55.557354 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.557328 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6k7zp"] Sep 17 02:44:55.559468 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:44:55.559445 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61bcaa3_28d6_4fcb_97f7_7f9384263d15.slice/crio-83d4e662aff1f40c15f2be0d1fe7b90271e7275633c8a5627d99eaf01f922f65 WatchSource:0}: Error finding container 83d4e662aff1f40c15f2be0d1fe7b90271e7275633c8a5627d99eaf01f922f65: Status 404 returned error can't find the container with id 83d4e662aff1f40c15f2be0d1fe7b90271e7275633c8a5627d99eaf01f922f65 Sep 17 02:44:55.592094 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.592063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6k7zp" event={"ID":"b61bcaa3-28d6-4fcb-97f7-7f9384263d15","Type":"ContainerStarted","Data":"83d4e662aff1f40c15f2be0d1fe7b90271e7275633c8a5627d99eaf01f922f65"} Sep 17 02:44:55.593150 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:44:55.593126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5tbz" event={"ID":"e151274c-f201-4606-8c17-0dc492507886","Type":"ContainerStarted","Data":"4031dfdc9deb6ecba2ac0fb7e14b9a9d8595d3768b6913ef16e88594ac9d31b9"} Sep 17 02:45:00.607833 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:00.607799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6k7zp" event={"ID":"b61bcaa3-28d6-4fcb-97f7-7f9384263d15","Type":"ContainerStarted","Data":"d162e61a04064f916760ab54b9bd65318e9eb8991f54f6527c3b1d78688ab666"} Sep 17 02:45:00.608304 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:00.607906 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:45:00.609323 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:00.609302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5tbz" event={"ID":"e151274c-f201-4606-8c17-0dc492507886","Type":"ContainerStarted","Data":"ddbf2003f09d8e3ccd5e5bc8770b19d0bc18898afadb89b577162f9fd4e0a734"} Sep 17 02:45:00.624928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:00.622708 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6k7zp" podStartSLOduration=67.168919568 podStartE2EDuration="1m11.622685841s" totalImagesPullingTime="4.453766273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:45:00.622260601 +0000 UTC m=+71.757376948" watchObservedRunningTime="2026-09-17 02:45:00.622685841 +0000 UTC m=+71.757802186" Sep 17 02:45:00.636401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:00.636361 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l5tbz" podStartSLOduration=67.156293357 podStartE2EDuration="1m11.63634887s" totalImagesPullingTime="4.480055513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:45:00.635668896 +0000 UTC m=+71.770785240" watchObservedRunningTime="2026-09-17 02:45:00.63634887 +0000 UTC m=+71.771465214" Sep 17 02:45:27.052458 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:27.052410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:27.052472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:27.052504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052572 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052592 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052593 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052623 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052641 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:46:31.052628402 +0000 UTC m=+162.187744724 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052654 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:46:31.05264794 +0000 UTC m=+162.187764262 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:45:27.052916 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:27.052679 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:46:31.052666009 +0000 UTC m=+162.187782330 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:45:31.614995 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:31.614964 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6k7zp" Sep 17 02:45:59.175317 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:45:59.175276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:45:59.175813 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:59.175463 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 02:45:59.175813 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:45:59.175529 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:01.175514798 +0000 UTC m=+252.310631121 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : secret "metrics-daemon-secret" not found Sep 17 02:46:26.191329 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:26.191284 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" podUID="1e3aad2f-5f5c-443f-8ef6-3295344373ca" Sep 17 02:46:26.201461 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:26.201432 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" Sep 17 02:46:26.218751 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:26.218713 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pcsrp" podUID="5f3c5a47-09c3-401c-8aac-30d325331c99" Sep 17 02:46:26.809797 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:26.809693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcsrp" Sep 17 02:46:26.809797 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:26.809695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:46:26.810024 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:26.809695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:46:27.336354 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:27.336315 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:46:31.097542 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:31.097505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:31.097567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:31.097623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097666 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097723 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097740 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097747 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert podName:1e3aad2f-5f5c-443f-8ef6-3295344373ca nodeName:}" failed. No retries permitted until 2026-09-17 02:48:33.097732065 +0000 UTC m=+284.232848412 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-9wwbf" (UID: "1e3aad2f-5f5c-443f-8ef6-3295344373ca") : secret "networking-console-plugin-cert" not found Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097754 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8648ff99b-tz2hs: secret "image-registry-tls" not found Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097774 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls podName:5f3c5a47-09c3-401c-8aac-30d325331c99 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:33.097760101 +0000 UTC m=+284.232876422 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls") pod "dns-default-pcsrp" (UID: "5f3c5a47-09c3-401c-8aac-30d325331c99") : secret "dns-default-metrics-tls" not found Sep 17 02:46:31.098109 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:46:31.097830 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls podName:92801ed5-a854-46b7-8821-9a0a952ded5a nodeName:}" failed. No retries permitted until 2026-09-17 02:48:33.097815968 +0000 UTC m=+284.232932294 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls") pod "image-registry-8648ff99b-tz2hs" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a") : secret "image-registry-tls" not found Sep 17 02:46:39.322103 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:46:39.322068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:48:01.217534 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:01.217483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:48:01.218041 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:01.217636 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 02:48:01.218041 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:01.217711 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs podName:ed18f6dd-2d32-4ec6-8a72-333b52cb92f6 nodeName:}" failed. No retries permitted until 2026-09-17 02:50:03.217695268 +0000 UTC m=+374.352811590 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs") pod "network-metrics-daemon-png44" (UID: "ed18f6dd-2d32-4ec6-8a72-333b52cb92f6") : secret "metrics-daemon-secret" not found Sep 17 02:48:06.976878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.976842 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt"] Sep 17 02:48:06.979657 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.979640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:06.982475 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.982449 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5j9sg\"" Sep 17 02:48:06.983619 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.983589 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 02:48:06.983619 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.983613 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 02:48:06.983846 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.983613 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 02:48:06.983846 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.983663 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 02:48:06.984593 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.984574 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-hcfz6"] Sep 17 02:48:06.987521 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.987505 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq"] Sep 17 02:48:06.987668 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.987650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:06.990064 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.990047 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh"] Sep 17 02:48:06.990171 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.990156 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:06.990428 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.990409 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 02:48:06.990798 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.990761 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 02:48:06.991105 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.991088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 02:48:06.991172 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.991139 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d46sk\"" Sep 17 02:48:06.991230 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.991175 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 02:48:06.992940 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.992923 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:06.993855 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.993837 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 02:48:06.995030 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.994986 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 02:48:06.995187 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.995170 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 02:48:06.995377 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.995178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8lshj\"" Sep 17 02:48:06.995451 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.995254 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 02:48:06.996496 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.996474 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 02:48:06.997393 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.997373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt"] Sep 17 02:48:06.997489 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.997432 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 02:48:06.997559 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.997444 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 02:48:06.997559 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.997478 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nhpcz\"" Sep 17 02:48:06.997800 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:06.997768 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 02:48:07.003016 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.002292 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-hcfz6"] Sep 17 02:48:07.003358 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.003342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq"] Sep 17 02:48:07.004206 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.004189 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh"] Sep 17 02:48:07.159687 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/099be3c7-100c-4f64-b861-f0944c92af73-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.159687 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clj2d\" (UniqueName: \"kubernetes.io/projected/b72e942f-db8e-48e2-8e44-b8d0af99166b-kube-api-access-clj2d\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.159920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkb6q\" (UniqueName: \"kubernetes.io/projected/099be3c7-100c-4f64-b861-f0944c92af73-kube-api-access-nkb6q\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.159920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:07.159920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm4wn\" (UniqueName: \"kubernetes.io/projected/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-kube-api-access-cm4wn\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:07.159920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72e942f-db8e-48e2-8e44-b8d0af99166b-trusted-ca-bundle\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.159920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.160122 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b72e942f-db8e-48e2-8e44-b8d0af99166b-snapshots\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.160122 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b72e942f-db8e-48e2-8e44-b8d0af99166b-tmp\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.160122 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.159976 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72e942f-db8e-48e2-8e44-b8d0af99166b-service-ca-bundle\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.160122 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.160014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.160122 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.160068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4gv\" (UniqueName: \"kubernetes.io/projected/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-kube-api-access-2b4gv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.160122 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.160093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.160295 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.160132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b72e942f-db8e-48e2-8e44-b8d0af99166b-serving-cert\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.260972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b72e942f-db8e-48e2-8e44-b8d0af99166b-serving-cert\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/099be3c7-100c-4f64-b861-f0944c92af73-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.261069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clj2d\" (UniqueName: \"kubernetes.io/projected/b72e942f-db8e-48e2-8e44-b8d0af99166b-kube-api-access-clj2d\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkb6q\" (UniqueName: \"kubernetes.io/projected/099be3c7-100c-4f64-b861-f0944c92af73-kube-api-access-nkb6q\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.261333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:07.261333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm4wn\" (UniqueName: \"kubernetes.io/projected/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-kube-api-access-cm4wn\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:07.261333 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.261251 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 02:48:07.261333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72e942f-db8e-48e2-8e44-b8d0af99166b-trusted-ca-bundle\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b72e942f-db8e-48e2-8e44-b8d0af99166b-snapshots\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.261411 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls podName:5cc32ece-b97a-4ece-b2ab-da7f60e958d0 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:07.761389066 +0000 UTC m=+258.896505402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-268zh" (UID: "5cc32ece-b97a-4ece-b2ab-da7f60e958d0") : secret "samples-operator-tls" not found Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b72e942f-db8e-48e2-8e44-b8d0af99166b-tmp\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.261476 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72e942f-db8e-48e2-8e44-b8d0af99166b-service-ca-bundle\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.261519 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls podName:099be3c7-100c-4f64-b861-f0944c92af73 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:07.761505172 +0000 UTC m=+258.896621495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rggzq" (UID: "099be3c7-100c-4f64-b861-f0944c92af73") : secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:07.261584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.262019 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4gv\" (UniqueName: \"kubernetes.io/projected/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-kube-api-access-2b4gv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.262019 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.261650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.262113 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.262087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72e942f-db8e-48e2-8e44-b8d0af99166b-service-ca-bundle\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.262159 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.262140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b72e942f-db8e-48e2-8e44-b8d0af99166b-tmp\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.262291 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.262261 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72e942f-db8e-48e2-8e44-b8d0af99166b-trusted-ca-bundle\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.262354 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.262261 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.262354 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.262292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b72e942f-db8e-48e2-8e44-b8d0af99166b-snapshots\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.262525 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.262504 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/099be3c7-100c-4f64-b861-f0944c92af73-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.263584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.263567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b72e942f-db8e-48e2-8e44-b8d0af99166b-serving-cert\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.263965 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.263939 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.270124 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.270101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm4wn\" (UniqueName: \"kubernetes.io/projected/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-kube-api-access-cm4wn\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:07.270393 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.270372 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkb6q\" (UniqueName: \"kubernetes.io/projected/099be3c7-100c-4f64-b861-f0944c92af73-kube-api-access-nkb6q\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.270488 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.270474 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clj2d\" (UniqueName: \"kubernetes.io/projected/b72e942f-db8e-48e2-8e44-b8d0af99166b-kube-api-access-clj2d\") pod \"insights-operator-5844b856db-hcfz6\" (UID: \"b72e942f-db8e-48e2-8e44-b8d0af99166b\") " pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.270526 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.270476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4gv\" (UniqueName: \"kubernetes.io/projected/f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a-kube-api-access-2b4gv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-v52nt\" (UID: \"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.289075 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.289050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" Sep 17 02:48:07.298456 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.298435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-hcfz6" Sep 17 02:48:07.563196 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.563016 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt"] Sep 17 02:48:07.565651 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:07.565626 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e6cb98_c7fa_4bb7_9dbd_2abcde9cae0a.slice/crio-19121bcc964cd46fd22bfe7dc6f49a62bfc90ae99996027cc639f03a67eb4150 WatchSource:0}: Error finding container 19121bcc964cd46fd22bfe7dc6f49a62bfc90ae99996027cc639f03a67eb4150: Status 404 returned error can't find the container with id 19121bcc964cd46fd22bfe7dc6f49a62bfc90ae99996027cc639f03a67eb4150 Sep 17 02:48:07.569735 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.569707 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-hcfz6"] Sep 17 02:48:07.572914 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:07.572888 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72e942f_db8e_48e2_8e44_b8d0af99166b.slice/crio-f10c94adf6f7ace68a74ff22cc8ec49d278f20a9da2c1f74ba98b468fe2bbb34 WatchSource:0}: Error finding container f10c94adf6f7ace68a74ff22cc8ec49d278f20a9da2c1f74ba98b468fe2bbb34: Status 404 returned error can't find the container with id f10c94adf6f7ace68a74ff22cc8ec49d278f20a9da2c1f74ba98b468fe2bbb34 Sep 17 02:48:07.765586 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.765554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:07.765729 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:07.765617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:07.765729 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.765694 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 02:48:07.765847 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.765752 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls podName:5cc32ece-b97a-4ece-b2ab-da7f60e958d0 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:08.76573805 +0000 UTC m=+259.900854377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-268zh" (UID: "5cc32ece-b97a-4ece-b2ab-da7f60e958d0") : secret "samples-operator-tls" not found Sep 17 02:48:07.765847 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.765752 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:07.765847 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:07.765815 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls podName:099be3c7-100c-4f64-b861-f0944c92af73 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:08.765799914 +0000 UTC m=+259.900916239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rggzq" (UID: "099be3c7-100c-4f64-b861-f0944c92af73") : secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:08.054486 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:08.054450 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hcfz6" event={"ID":"b72e942f-db8e-48e2-8e44-b8d0af99166b","Type":"ContainerStarted","Data":"f10c94adf6f7ace68a74ff22cc8ec49d278f20a9da2c1f74ba98b468fe2bbb34"} Sep 17 02:48:08.055574 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:08.055550 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" event={"ID":"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a","Type":"ContainerStarted","Data":"19121bcc964cd46fd22bfe7dc6f49a62bfc90ae99996027cc639f03a67eb4150"} Sep 17 02:48:08.773828 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:08.773772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:08.774016 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:08.773850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:08.774016 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:08.774008 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:08.774125 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:08.774070 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls podName:099be3c7-100c-4f64-b861-f0944c92af73 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:10.774052017 +0000 UTC m=+261.909168386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rggzq" (UID: "099be3c7-100c-4f64-b861-f0944c92af73") : secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:08.774267 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:08.774242 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 02:48:08.774403 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:08.774304 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls podName:5cc32ece-b97a-4ece-b2ab-da7f60e958d0 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:10.774286751 +0000 UTC m=+261.909403074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-268zh" (UID: "5cc32ece-b97a-4ece-b2ab-da7f60e958d0") : secret "samples-operator-tls" not found Sep 17 02:48:10.792024 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:10.791984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:10.792469 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:10.792052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:10.792469 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:10.792123 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 02:48:10.792469 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:10.792152 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:10.792469 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:10.792186 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls podName:5cc32ece-b97a-4ece-b2ab-da7f60e958d0 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:14.792172038 +0000 UTC m=+265.927288365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-268zh" (UID: "5cc32ece-b97a-4ece-b2ab-da7f60e958d0") : secret "samples-operator-tls" not found Sep 17 02:48:10.792469 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:10.792202 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls podName:099be3c7-100c-4f64-b861-f0944c92af73 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:14.792194564 +0000 UTC m=+265.927310885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rggzq" (UID: "099be3c7-100c-4f64-b861-f0944c92af73") : secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:11.070599 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.070493 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hcfz6" event={"ID":"b72e942f-db8e-48e2-8e44-b8d0af99166b","Type":"ContainerStarted","Data":"db09134e6de4467731348728dce842b56bf44fde35511814f988c38708f75471"} Sep 17 02:48:11.071973 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.071945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" event={"ID":"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a","Type":"ContainerStarted","Data":"2e3780017137544739a53ed5fcafd361704551c0a402202a6419a01953039617"} Sep 17 02:48:11.087577 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.087528 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-hcfz6" podStartSLOduration=2.53349987 podStartE2EDuration="5.087508461s" totalImagesPullingTime="2.554008591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:11.085586187 +0000 UTC m=+262.220702530" watchObservedRunningTime="2026-09-17 02:48:11.087508461 +0000 UTC m=+262.222624807" Sep 17 02:48:11.100747 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.100704 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" podStartSLOduration=2.536219232 podStartE2EDuration="5.100689983s" totalImagesPullingTime="2.564470751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:11.100090969 +0000 UTC m=+262.235207313" watchObservedRunningTime="2026-09-17 02:48:11.100689983 +0000 UTC m=+262.235806327" Sep 17 02:48:11.373153 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.373076 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9"] Sep 17 02:48:11.376447 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.376414 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" Sep 17 02:48:11.378992 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.378971 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-czsmr\"" Sep 17 02:48:11.379111 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.379006 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 02:48:11.379111 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.379006 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 02:48:11.385752 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.385731 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9"] Sep 17 02:48:11.499234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.499202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvspf\" (UniqueName: \"kubernetes.io/projected/ba06754f-a033-439f-be89-35e19893ad02-kube-api-access-bvspf\") pod \"migrator-8b4d697c5-549g9\" (UID: \"ba06754f-a033-439f-be89-35e19893ad02\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" Sep 17 02:48:11.558779 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.558747 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8nqrk"] Sep 17 02:48:11.561748 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.561728 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.564099 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.564078 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 02:48:11.564338 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.564319 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t6qnt\"" Sep 17 02:48:11.564415 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.564381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 02:48:11.575708 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.575685 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8nqrk"] Sep 17 02:48:11.600517 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.600488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvspf\" (UniqueName: \"kubernetes.io/projected/ba06754f-a033-439f-be89-35e19893ad02-kube-api-access-bvspf\") pod \"migrator-8b4d697c5-549g9\" (UID: \"ba06754f-a033-439f-be89-35e19893ad02\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" Sep 17 02:48:11.608688 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.608665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvspf\" (UniqueName: \"kubernetes.io/projected/ba06754f-a033-439f-be89-35e19893ad02-kube-api-access-bvspf\") pod \"migrator-8b4d697c5-549g9\" (UID: \"ba06754f-a033-439f-be89-35e19893ad02\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" Sep 17 02:48:11.686496 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.686408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" Sep 17 02:48:11.701240 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.701212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f67352-1335-428c-9cc7-d461177f36b8-crio-socket\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.701350 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.701250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjq8\" (UniqueName: \"kubernetes.io/projected/73f67352-1335-428c-9cc7-d461177f36b8-kube-api-access-5vjq8\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.701350 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.701279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f67352-1335-428c-9cc7-d461177f36b8-data-volume\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.701350 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.701330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.701469 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.701386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802290 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802341 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:11.802380 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f67352-1335-428c-9cc7-d461177f36b8-crio-socket\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjq8\" (UniqueName: \"kubernetes.io/projected/73f67352-1335-428c-9cc7-d461177f36b8-kube-api-access-5vjq8\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:11.802462 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:12.302445625 +0000 UTC m=+263.437561948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : configmap "kube-rbac-proxy" not found Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f67352-1335-428c-9cc7-d461177f36b8-data-volume\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:11.802490 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f67352-1335-428c-9cc7-d461177f36b8-crio-socket\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.802615 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:11.802554 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:12.302537416 +0000 UTC m=+263.437653758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : secret "insights-runtime-extractor-tls" not found Sep 17 02:48:11.802952 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.802843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f67352-1335-428c-9cc7-d461177f36b8-data-volume\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.810672 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.810649 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjq8\" (UniqueName: \"kubernetes.io/projected/73f67352-1335-428c-9cc7-d461177f36b8-kube-api-access-5vjq8\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:11.948959 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:11.948931 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9"] Sep 17 02:48:11.952808 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:11.952768 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba06754f_a033_439f_be89_35e19893ad02.slice/crio-8836953dcbfbc37da562407b2e485e9d55a82a7a15c8ab00c276f96341d71013 WatchSource:0}: Error finding container 8836953dcbfbc37da562407b2e485e9d55a82a7a15c8ab00c276f96341d71013: Status 404 returned error can't find the container with id 8836953dcbfbc37da562407b2e485e9d55a82a7a15c8ab00c276f96341d71013 Sep 17 02:48:12.075644 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:12.075609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" event={"ID":"ba06754f-a033-439f-be89-35e19893ad02","Type":"ContainerStarted","Data":"8836953dcbfbc37da562407b2e485e9d55a82a7a15c8ab00c276f96341d71013"} Sep 17 02:48:12.307767 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:12.307683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:12.307767 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:12.307751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:12.307975 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:12.307812 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 02:48:12.307975 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:12.307851 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 02:48:12.307975 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:12.307876 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:13.307861302 +0000 UTC m=+264.442977628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : configmap "kube-rbac-proxy" not found Sep 17 02:48:12.307975 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:12.307892 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:13.307886117 +0000 UTC m=+264.443002438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : secret "insights-runtime-extractor-tls" not found Sep 17 02:48:13.316057 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:13.316031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:13.316321 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:13.316090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:13.316321 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:13.316141 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 02:48:13.316321 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:13.316185 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 02:48:13.316321 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:13.316202 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:15.316186227 +0000 UTC m=+266.451302551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : configmap "kube-rbac-proxy" not found Sep 17 02:48:13.316321 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:13.316229 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:15.316218867 +0000 UTC m=+266.451335216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : secret "insights-runtime-extractor-tls" not found Sep 17 02:48:14.082858 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:14.082820 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" event={"ID":"ba06754f-a033-439f-be89-35e19893ad02","Type":"ContainerStarted","Data":"abd536cfe215dfeecea1d422aae50ed0e4950ea507f6084c652289472eba3436"} Sep 17 02:48:14.083065 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:14.082914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" event={"ID":"ba06754f-a033-439f-be89-35e19893ad02","Type":"ContainerStarted","Data":"a2a0725f342f1d657212d0cdc07d1cd08398b28458c9c61ac40517065fe7a7b2"} Sep 17 02:48:14.098202 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:14.098160 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-549g9" podStartSLOduration=1.762102723 podStartE2EDuration="3.098146686s" totalImagesPullingTime="1.336043963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:14.097555932 +0000 UTC m=+265.232672276" watchObservedRunningTime="2026-09-17 02:48:14.098146686 +0000 UTC m=+265.233263063" Sep 17 02:48:14.524118 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:14.524092 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qmq5n_273cbf5e-736f-4ef0-bde7-31f77e2a26be/dns-node-resolver/0.log" Sep 17 02:48:14.831327 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:14.831244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:14.831327 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:14.831304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:14.831502 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:14.831400 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 02:48:14.831502 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:14.831432 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:14.831502 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:14.831466 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls podName:5cc32ece-b97a-4ece-b2ab-da7f60e958d0 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:22.831449146 +0000 UTC m=+273.966565487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-268zh" (UID: "5cc32ece-b97a-4ece-b2ab-da7f60e958d0") : secret "samples-operator-tls" not found Sep 17 02:48:14.831502 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:14.831482 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls podName:099be3c7-100c-4f64-b861-f0944c92af73 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:22.831474764 +0000 UTC m=+273.966591086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rggzq" (UID: "099be3c7-100c-4f64-b861-f0944c92af73") : secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:15.123377 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.123302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gkklv_5c405b6c-9d6b-4377-89d7-4242a41c6102/node-ca/0.log" Sep 17 02:48:15.133190 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.133164 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-66nv8"] Sep 17 02:48:15.136154 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.136137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.138457 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.138432 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 02:48:15.139685 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.139662 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 02:48:15.139809 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.139668 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 02:48:15.139809 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.139713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 02:48:15.139809 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.139668 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zbfzl\"" Sep 17 02:48:15.143405 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.143385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-66nv8"] Sep 17 02:48:15.234384 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.234359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad64adcd-1d0c-4e5d-98ee-38008d66f962-signing-cabundle\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.234518 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.234489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad64adcd-1d0c-4e5d-98ee-38008d66f962-signing-key\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.234557 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.234531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fhlj\" (UniqueName: \"kubernetes.io/projected/ad64adcd-1d0c-4e5d-98ee-38008d66f962-kube-api-access-5fhlj\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.334950 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.334927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad64adcd-1d0c-4e5d-98ee-38008d66f962-signing-cabundle\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.335070 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.334973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:15.335070 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.335029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:15.335070 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.335050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad64adcd-1d0c-4e5d-98ee-38008d66f962-signing-key\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.335203 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.335086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fhlj\" (UniqueName: \"kubernetes.io/projected/ad64adcd-1d0c-4e5d-98ee-38008d66f962-kube-api-access-5fhlj\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.335203 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:15.335133 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 02:48:15.335203 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:15.335162 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 02:48:15.335203 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:15.335193 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:19.335175067 +0000 UTC m=+270.470291397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : configmap "kube-rbac-proxy" not found Sep 17 02:48:15.335411 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:15.335211 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:19.335202805 +0000 UTC m=+270.470319127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : secret "insights-runtime-extractor-tls" not found Sep 17 02:48:15.335649 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.335632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad64adcd-1d0c-4e5d-98ee-38008d66f962-signing-cabundle\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.337464 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.337440 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad64adcd-1d0c-4e5d-98ee-38008d66f962-signing-key\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.342850 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.342830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fhlj\" (UniqueName: \"kubernetes.io/projected/ad64adcd-1d0c-4e5d-98ee-38008d66f962-kube-api-access-5fhlj\") pod \"service-ca-568869fdc5-66nv8\" (UID: \"ad64adcd-1d0c-4e5d-98ee-38008d66f962\") " pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.445199 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.445181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-66nv8" Sep 17 02:48:15.709295 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:15.709219 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-66nv8"] Sep 17 02:48:15.712854 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:15.712823 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad64adcd_1d0c_4e5d_98ee_38008d66f962.slice/crio-ae3140c6edbd898507788b48038d836e6db1954440a3962d72d9b4e7d0811a22 WatchSource:0}: Error finding container ae3140c6edbd898507788b48038d836e6db1954440a3962d72d9b4e7d0811a22: Status 404 returned error can't find the container with id ae3140c6edbd898507788b48038d836e6db1954440a3962d72d9b4e7d0811a22 Sep 17 02:48:16.090151 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:16.090072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-66nv8" event={"ID":"ad64adcd-1d0c-4e5d-98ee-38008d66f962","Type":"ContainerStarted","Data":"ae3140c6edbd898507788b48038d836e6db1954440a3962d72d9b4e7d0811a22"} Sep 17 02:48:16.324426 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:16.324395 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-npb4m_191ed4a8-cff5-43e6-9b83-a9fb15d4846d/serve-healthcheck-canary/0.log" Sep 17 02:48:16.524353 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:16.524325 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-549g9_ba06754f-a033-439f-be89-35e19893ad02/migrator/0.log" Sep 17 02:48:16.723676 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:16.723646 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-549g9_ba06754f-a033-439f-be89-35e19893ad02/graceful-termination/0.log" Sep 17 02:48:16.924672 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:16.924602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-v52nt_f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a/kube-storage-version-migrator-operator/0.log" Sep 17 02:48:18.099327 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:18.099289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-66nv8" event={"ID":"ad64adcd-1d0c-4e5d-98ee-38008d66f962","Type":"ContainerStarted","Data":"89f7491de03fc36416de8a9aa2082e27fa193fb9d50ad511664644cd3348ffa8"} Sep 17 02:48:18.115285 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:18.115233 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-66nv8" podStartSLOduration=1.353495634 podStartE2EDuration="3.11521999s" totalImagesPullingTime="1.761724356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:18.113554584 +0000 UTC m=+269.248670928" watchObservedRunningTime="2026-09-17 02:48:18.11521999 +0000 UTC m=+269.250336398" Sep 17 02:48:19.367156 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:19.367106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:19.367576 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:19.367219 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 02:48:19.367576 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:19.367275 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:27.367260593 +0000 UTC m=+278.502376915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : configmap "kube-rbac-proxy" not found Sep 17 02:48:19.367576 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:19.367217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:19.367576 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:19.367310 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 02:48:19.367576 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:19.367364 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:27.367349649 +0000 UTC m=+278.502465978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : secret "insights-runtime-extractor-tls" not found Sep 17 02:48:22.896669 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:22.896635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:22.897036 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:22.896699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:22.897036 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:22.896804 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:22.897036 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:22.896871 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls podName:099be3c7-100c-4f64-b861-f0944c92af73 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:38.896855778 +0000 UTC m=+290.031972105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rggzq" (UID: "099be3c7-100c-4f64-b861-f0944c92af73") : secret "cluster-monitoring-operator-tls" not found Sep 17 02:48:22.899006 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:22.898987 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cc32ece-b97a-4ece-b2ab-da7f60e958d0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-268zh\" (UID: \"5cc32ece-b97a-4ece-b2ab-da7f60e958d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:22.911740 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:22.911716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" Sep 17 02:48:23.178939 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:23.178911 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh"] Sep 17 02:48:24.118992 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:24.118955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" event={"ID":"5cc32ece-b97a-4ece-b2ab-da7f60e958d0","Type":"ContainerStarted","Data":"adad6db12de19c2e14c96eefaed999543dee2aea8cd199145d011cbe037f28ad"} Sep 17 02:48:25.124653 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:25.124576 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" event={"ID":"5cc32ece-b97a-4ece-b2ab-da7f60e958d0","Type":"ContainerStarted","Data":"c76df7a328833c6d3bcee4e84dbdfccebcebbd9187210960773b41b13fbb6e19"} Sep 17 02:48:25.124653 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:25.124657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" event={"ID":"5cc32ece-b97a-4ece-b2ab-da7f60e958d0","Type":"ContainerStarted","Data":"48706d3122c499f0d97074649542590c8a3b28df4a11bb318b1c91b23b8f1d43"} Sep 17 02:48:25.140420 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:25.140366 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-268zh" podStartSLOduration=17.497108168 podStartE2EDuration="19.140347072s" totalImagesPullingTime="1.643238904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:25.139090686 +0000 UTC m=+276.274207032" watchObservedRunningTime="2026-09-17 02:48:25.140347072 +0000 UTC m=+276.275463417" Sep 17 02:48:27.439146 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:27.439105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:27.439504 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:27.439174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:27.439504 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:27.439278 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 02:48:27.439504 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:27.439339 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls podName:73f67352-1335-428c-9cc7-d461177f36b8 nodeName:}" failed. No retries permitted until 2026-09-17 02:48:43.439326618 +0000 UTC m=+294.574442945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8nqrk" (UID: "73f67352-1335-428c-9cc7-d461177f36b8") : secret "insights-runtime-extractor-tls" not found Sep 17 02:48:27.439670 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:27.439651 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f67352-1335-428c-9cc7-d461177f36b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:29.810151 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:29.810097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pcsrp" podUID="5f3c5a47-09c3-401c-8aac-30d325331c99" Sep 17 02:48:29.810618 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:29.810230 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" podUID="1e3aad2f-5f5c-443f-8ef6-3295344373ca" Sep 17 02:48:29.810618 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:29.810351 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" Sep 17 02:48:30.138802 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:30.138710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:48:30.138947 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:30.138711 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcsrp" Sep 17 02:48:30.138947 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:30.138710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:48:33.183606 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.183577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:48:33.184203 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.183625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:48:33.184203 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.183677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:48:33.185958 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.185934 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f3c5a47-09c3-401c-8aac-30d325331c99-metrics-tls\") pod \"dns-default-pcsrp\" (UID: \"5f3c5a47-09c3-401c-8aac-30d325331c99\") " pod="openshift-dns/dns-default-pcsrp" Sep 17 02:48:33.186543 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.186524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e3aad2f-5f5c-443f-8ef6-3295344373ca-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-9wwbf\" (UID: \"1e3aad2f-5f5c-443f-8ef6-3295344373ca\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:48:33.186677 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.186653 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"image-registry-8648ff99b-tz2hs\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:48:33.443425 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.443392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tbj68\"" Sep 17 02:48:33.443584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.443392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wcv2b\"" Sep 17 02:48:33.443584 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.443409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cm2j6\"" Sep 17 02:48:33.449594 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.449572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:48:33.449594 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.449590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" Sep 17 02:48:33.449742 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.449700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcsrp" Sep 17 02:48:33.725644 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.725574 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8648ff99b-tz2hs"] Sep 17 02:48:33.728377 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.728356 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf"] Sep 17 02:48:33.729532 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:33.729512 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92801ed5_a854_46b7_8821_9a0a952ded5a.slice/crio-0fa20ec74687c276be60170f1786354d5973bad96b986a4c1428140c73bc3389 WatchSource:0}: Error finding container 0fa20ec74687c276be60170f1786354d5973bad96b986a4c1428140c73bc3389: Status 404 returned error can't find the container with id 0fa20ec74687c276be60170f1786354d5973bad96b986a4c1428140c73bc3389 Sep 17 02:48:33.729708 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:33.729687 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pcsrp"] Sep 17 02:48:33.730736 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:33.730715 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3aad2f_5f5c_443f_8ef6_3295344373ca.slice/crio-a4de7c58b113c3cf9d857b9cc291c167ee2fe8ebeae721a3ce9f9a47ad32e4cc WatchSource:0}: Error finding container a4de7c58b113c3cf9d857b9cc291c167ee2fe8ebeae721a3ce9f9a47ad32e4cc: Status 404 returned error can't find the container with id a4de7c58b113c3cf9d857b9cc291c167ee2fe8ebeae721a3ce9f9a47ad32e4cc Sep 17 02:48:33.731569 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:33.731534 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3c5a47_09c3_401c_8aac_30d325331c99.slice/crio-fc5101d4388c5f8b09a3650c19eb9affb79b1f3c810f2a1fcd1817f57a378cb8 WatchSource:0}: Error finding container fc5101d4388c5f8b09a3650c19eb9affb79b1f3c810f2a1fcd1817f57a378cb8: Status 404 returned error can't find the container with id fc5101d4388c5f8b09a3650c19eb9affb79b1f3c810f2a1fcd1817f57a378cb8 Sep 17 02:48:34.152844 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:34.152738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcsrp" event={"ID":"5f3c5a47-09c3-401c-8aac-30d325331c99","Type":"ContainerStarted","Data":"fc5101d4388c5f8b09a3650c19eb9affb79b1f3c810f2a1fcd1817f57a378cb8"} Sep 17 02:48:34.154372 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:34.154344 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" event={"ID":"92801ed5-a854-46b7-8821-9a0a952ded5a","Type":"ContainerStarted","Data":"6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde"} Sep 17 02:48:34.154506 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:34.154385 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" event={"ID":"92801ed5-a854-46b7-8821-9a0a952ded5a","Type":"ContainerStarted","Data":"0fa20ec74687c276be60170f1786354d5973bad96b986a4c1428140c73bc3389"} Sep 17 02:48:34.154506 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:34.154404 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:48:34.155555 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:34.155530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" event={"ID":"1e3aad2f-5f5c-443f-8ef6-3295344373ca","Type":"ContainerStarted","Data":"a4de7c58b113c3cf9d857b9cc291c167ee2fe8ebeae721a3ce9f9a47ad32e4cc"} Sep 17 02:48:34.177462 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:34.177421 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" podStartSLOduration=285.177408331 podStartE2EDuration="4m45.177408331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:34.1760529 +0000 UTC m=+285.311169246" watchObservedRunningTime="2026-09-17 02:48:34.177408331 +0000 UTC m=+285.312524675" Sep 17 02:48:35.160670 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:35.160632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" event={"ID":"1e3aad2f-5f5c-443f-8ef6-3295344373ca","Type":"ContainerStarted","Data":"d67a98837579bb2b09a5d4d73fafb56c07c0e517b8ad03c76d921f563d1facb3"} Sep 17 02:48:35.175972 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:35.175925 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-9wwbf" podStartSLOduration=266.966496005 podStartE2EDuration="4m28.175906411s" totalImagesPullingTime="1.209410406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:35.174761561 +0000 UTC m=+286.309877905" watchObservedRunningTime="2026-09-17 02:48:35.175906411 +0000 UTC m=+286.311022754" Sep 17 02:48:36.165091 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:36.165053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcsrp" event={"ID":"5f3c5a47-09c3-401c-8aac-30d325331c99","Type":"ContainerStarted","Data":"14e9011b90dd5c9a766b265926c400bf7b972b0654f12489eb44917c6c6162ab"} Sep 17 02:48:36.165470 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:36.165124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcsrp" event={"ID":"5f3c5a47-09c3-401c-8aac-30d325331c99","Type":"ContainerStarted","Data":"fc3e68e9e5fa23977564e3ed03175e87c4aeb3a2b2bda7c7684d27abd23e2914"} Sep 17 02:48:36.165470 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:36.165292 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pcsrp" Sep 17 02:48:36.182214 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:36.182172 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pcsrp" podStartSLOduration=250.975358785 podStartE2EDuration="4m13.182156129s" totalImagesPullingTime="2.206797344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:36.18045821 +0000 UTC m=+287.315574555" watchObservedRunningTime="2026-09-17 02:48:36.182156129 +0000 UTC m=+287.317272473" Sep 17 02:48:38.931823 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:38.931761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:38.934145 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:38.934118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099be3c7-100c-4f64-b861-f0944c92af73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rggzq\" (UID: \"099be3c7-100c-4f64-b861-f0944c92af73\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:39.106538 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:39.106501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" Sep 17 02:48:39.376023 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:39.376002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq"] Sep 17 02:48:39.380076 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:39.380048 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099be3c7_100c_4f64_b861_f0944c92af73.slice/crio-13355cf3862fbac88a16c9414ed01fc31d00441a85c54c40cdfa5e4232bc0bb8 WatchSource:0}: Error finding container 13355cf3862fbac88a16c9414ed01fc31d00441a85c54c40cdfa5e4232bc0bb8: Status 404 returned error can't find the container with id 13355cf3862fbac88a16c9414ed01fc31d00441a85c54c40cdfa5e4232bc0bb8 Sep 17 02:48:40.180093 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:40.180057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" event={"ID":"099be3c7-100c-4f64-b861-f0944c92af73","Type":"ContainerStarted","Data":"13355cf3862fbac88a16c9414ed01fc31d00441a85c54c40cdfa5e4232bc0bb8"} Sep 17 02:48:41.822952 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:41.822917 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj"] Sep 17 02:48:41.826203 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:41.826185 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:41.828711 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:41.828689 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 02:48:41.828835 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:41.828739 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jmkv2\"" Sep 17 02:48:41.833473 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:41.833453 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj"] Sep 17 02:48:41.958754 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:41.958710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-l8tcj\" (UID: \"221eeb39-cb5d-41cb-bd14-b03025632aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:42.060085 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:42.060058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-l8tcj\" (UID: \"221eeb39-cb5d-41cb-bd14-b03025632aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:42.060240 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:42.060219 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 02:48:42.060308 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:42.060297 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates podName:221eeb39-cb5d-41cb-bd14-b03025632aee nodeName:}" failed. No retries permitted until 2026-09-17 02:48:42.560278012 +0000 UTC m=+293.695394342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-l8tcj" (UID: "221eeb39-cb5d-41cb-bd14-b03025632aee") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 02:48:42.189354 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:42.189321 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" event={"ID":"099be3c7-100c-4f64-b861-f0944c92af73","Type":"ContainerStarted","Data":"33b6da040d03067319ff973840dc1a1a5aeee47fb12cb125d46d8d6f1ab442e4"} Sep 17 02:48:42.206574 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:42.206497 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rggzq" podStartSLOduration=34.233433517 podStartE2EDuration="36.206477076s" totalImagesPullingTime="1.973043559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:42.205830027 +0000 UTC m=+293.340946373" watchObservedRunningTime="2026-09-17 02:48:42.206477076 +0000 UTC m=+293.341593421" Sep 17 02:48:42.323475 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:42.323436 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-png44" podUID="ed18f6dd-2d32-4ec6-8a72-333b52cb92f6" Sep 17 02:48:42.564270 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:42.564173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-l8tcj\" (UID: \"221eeb39-cb5d-41cb-bd14-b03025632aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:42.564431 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:42.564342 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 02:48:42.564431 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:42.564422 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates podName:221eeb39-cb5d-41cb-bd14-b03025632aee nodeName:}" failed. No retries permitted until 2026-09-17 02:48:43.564402416 +0000 UTC m=+294.699518738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-l8tcj" (UID: "221eeb39-cb5d-41cb-bd14-b03025632aee") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 02:48:43.470763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.470726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:43.472977 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.472957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f67352-1335-428c-9cc7-d461177f36b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nqrk\" (UID: \"73f67352-1335-428c-9cc7-d461177f36b8\") " pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:43.571241 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.571210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-l8tcj\" (UID: \"221eeb39-cb5d-41cb-bd14-b03025632aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:43.573522 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.573498 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/221eeb39-cb5d-41cb-bd14-b03025632aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-l8tcj\" (UID: \"221eeb39-cb5d-41cb-bd14-b03025632aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:43.635542 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.635501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:43.670578 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.670544 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8nqrk" Sep 17 02:48:43.901923 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.901884 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj"] Sep 17 02:48:43.904493 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:43.904468 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221eeb39_cb5d_41cb_bd14_b03025632aee.slice/crio-50770382da70fb8858226b846c8a70d62e658db1c88ea8a5a2d2bba6fa32dbee WatchSource:0}: Error finding container 50770382da70fb8858226b846c8a70d62e658db1c88ea8a5a2d2bba6fa32dbee: Status 404 returned error can't find the container with id 50770382da70fb8858226b846c8a70d62e658db1c88ea8a5a2d2bba6fa32dbee Sep 17 02:48:43.950060 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:43.949965 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8nqrk"] Sep 17 02:48:43.951973 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:43.951946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f67352_1335_428c_9cc7_d461177f36b8.slice/crio-e6102448d40ae2e5954ba003e115fb0df819d3684626e62e73b9fec094a7f012 WatchSource:0}: Error finding container e6102448d40ae2e5954ba003e115fb0df819d3684626e62e73b9fec094a7f012: Status 404 returned error can't find the container with id e6102448d40ae2e5954ba003e115fb0df819d3684626e62e73b9fec094a7f012 Sep 17 02:48:44.198365 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:44.198331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nqrk" event={"ID":"73f67352-1335-428c-9cc7-d461177f36b8","Type":"ContainerStarted","Data":"3da498ca5a0ba42362f9dfaf1ca4caf3a86e422149d10c561f0b3cc354e918a0"} Sep 17 02:48:44.198538 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:44.198396 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nqrk" event={"ID":"73f67352-1335-428c-9cc7-d461177f36b8","Type":"ContainerStarted","Data":"e6102448d40ae2e5954ba003e115fb0df819d3684626e62e73b9fec094a7f012"} Sep 17 02:48:44.199472 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:44.199448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" event={"ID":"221eeb39-cb5d-41cb-bd14-b03025632aee","Type":"ContainerStarted","Data":"50770382da70fb8858226b846c8a70d62e658db1c88ea8a5a2d2bba6fa32dbee"} Sep 17 02:48:45.204523 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.204491 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" event={"ID":"221eeb39-cb5d-41cb-bd14-b03025632aee","Type":"ContainerStarted","Data":"944d046d85aeb064c15060401e2bdb129f014e4fa93fc16485d81736d0d3dd33"} Sep 17 02:48:45.204915 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.204582 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:45.206381 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.206356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nqrk" event={"ID":"73f67352-1335-428c-9cc7-d461177f36b8","Type":"ContainerStarted","Data":"76ceb8089afb44e71d546c7629ec77f29eec3fc060439dd162b4f3c3119277c6"} Sep 17 02:48:45.209529 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.209496 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" Sep 17 02:48:45.220355 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.220318 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-l8tcj" podStartSLOduration=3.008208577 podStartE2EDuration="4.220305767s" totalImagesPullingTime="1.21209719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:45.219626598 +0000 UTC m=+296.354742942" watchObservedRunningTime="2026-09-17 02:48:45.220305767 +0000 UTC m=+296.355422110" Sep 17 02:48:45.930116 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.930079 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-ss745"] Sep 17 02:48:45.933665 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.933636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:45.936612 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.936523 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 02:48:45.936612 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.936538 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 02:48:45.936803 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.936670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rdq7r\"" Sep 17 02:48:45.937987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.937957 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 02:48:45.948190 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:45.948170 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-ss745"] Sep 17 02:48:46.089960 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.089922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.090139 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.090013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6677v\" (UniqueName: \"kubernetes.io/projected/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-kube-api-access-6677v\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.090139 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.090045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.090139 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.090075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.170768 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.170727 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pcsrp" Sep 17 02:48:46.190765 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.190732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6677v\" (UniqueName: \"kubernetes.io/projected/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-kube-api-access-6677v\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.190929 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.190769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.190929 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.190814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.190929 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.190835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.191369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.191347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.193094 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.193064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.193094 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.193086 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.205966 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.205939 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6677v\" (UniqueName: \"kubernetes.io/projected/6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82-kube-api-access-6677v\") pod \"prometheus-operator-68bcd7f987-ss745\" (UID: \"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.244486 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.244461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" Sep 17 02:48:46.512677 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:46.512650 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-ss745"] Sep 17 02:48:46.514959 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:46.514933 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef5927c_4fbe_4f2b_aa7f_f3fcf2328d82.slice/crio-fbbbf4853d433ccfaf63b866edcf7a99add7d494d282e09e50f87951bf1b0494 WatchSource:0}: Error finding container fbbbf4853d433ccfaf63b866edcf7a99add7d494d282e09e50f87951bf1b0494: Status 404 returned error can't find the container with id fbbbf4853d433ccfaf63b866edcf7a99add7d494d282e09e50f87951bf1b0494 Sep 17 02:48:47.216871 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:47.216825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nqrk" event={"ID":"73f67352-1335-428c-9cc7-d461177f36b8","Type":"ContainerStarted","Data":"5f7c017dd46bb073b8ff8138e13b5eb302d84051e6b4d233d56e789a049dff4c"} Sep 17 02:48:47.218209 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:47.218181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" event={"ID":"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82","Type":"ContainerStarted","Data":"fbbbf4853d433ccfaf63b866edcf7a99add7d494d282e09e50f87951bf1b0494"} Sep 17 02:48:47.236397 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:47.236344 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8nqrk" podStartSLOduration=34.063835313 podStartE2EDuration="36.23633102s" totalImagesPullingTime="2.172495707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:48:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:47.236265346 +0000 UTC m=+298.371381693" watchObservedRunningTime="2026-09-17 02:48:47.23633102 +0000 UTC m=+298.371447363" Sep 17 02:48:48.223032 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:48.222999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" event={"ID":"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82","Type":"ContainerStarted","Data":"1604ccf0cd662faf9e43b38ac99bbd8e8e7c784a8fb772b4d50ac39344c714d7"} Sep 17 02:48:48.223403 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:48.223051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" event={"ID":"6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82","Type":"ContainerStarted","Data":"0dc0132157025f239d98121381a1ed47af333f7a7e7c982207a61580156e6117"} Sep 17 02:48:48.242569 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:48.242524 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-ss745" podStartSLOduration=1.965895262 podStartE2EDuration="3.242510601s" totalImagesPullingTime="1.276615339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:48.241353837 +0000 UTC m=+299.376470181" watchObservedRunningTime="2026-09-17 02:48:48.242510601 +0000 UTC m=+299.377626945" Sep 17 02:48:49.245916 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:49.245888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:48:49.246375 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:49.245890 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:48:49.253085 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:49.253063 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 02:48:50.239883 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.239848 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4"] Sep 17 02:48:50.243178 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.243159 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.245928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.245731 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vrqf4\"" Sep 17 02:48:50.245928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.245832 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 02:48:50.245928 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.245867 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 02:48:50.253249 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.253225 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4"] Sep 17 02:48:50.266922 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.266901 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8zxwt"] Sep 17 02:48:50.270024 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.270003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.272638 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.272618 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 02:48:50.272773 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.272754 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 02:48:50.272860 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.272845 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zk7d8\"" Sep 17 02:48:50.272952 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.272888 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 02:48:50.419778 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.419739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-wtmp\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.419956 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.419827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e30a2ea8-5137-4dbc-8644-ba8623a34146-metrics-client-ca\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.419956 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.419866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.419956 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.419902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jd75\" (UniqueName: \"kubernetes.io/projected/e30a2ea8-5137-4dbc-8644-ba8623a34146-kube-api-access-8jd75\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.420078 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.419956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-sys\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.420078 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4849299-08b5-4025-a67d-d8a83fe5cf22-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.420078 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-textfile\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.420078 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-root\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.420232 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.420232 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4849299-08b5-4025-a67d-d8a83fe5cf22-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.420232 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s559n\" (UniqueName: \"kubernetes.io/projected/f4849299-08b5-4025-a67d-d8a83fe5cf22-kube-api-access-s559n\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.420232 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-tls\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.420386 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.420250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4849299-08b5-4025-a67d-d8a83fe5cf22-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.521076 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jd75\" (UniqueName: \"kubernetes.io/projected/e30a2ea8-5137-4dbc-8644-ba8623a34146-kube-api-access-8jd75\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521076 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-sys\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521076 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4849299-08b5-4025-a67d-d8a83fe5cf22-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.521331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-textfile\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-root\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-sys\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521183 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-root\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521331 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4849299-08b5-4025-a67d-d8a83fe5cf22-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.521631 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s559n\" (UniqueName: \"kubernetes.io/projected/f4849299-08b5-4025-a67d-d8a83fe5cf22-kube-api-access-s559n\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.521631 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-textfile\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521631 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-tls\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521631 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4849299-08b5-4025-a67d-d8a83fe5cf22-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.521849 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-wtmp\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521849 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e30a2ea8-5137-4dbc-8644-ba8623a34146-metrics-client-ca\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521849 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.521993 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.521871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.522047 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.522011 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-wtmp\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.522418 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.522365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4849299-08b5-4025-a67d-d8a83fe5cf22-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.522563 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.522423 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e30a2ea8-5137-4dbc-8644-ba8623a34146-metrics-client-ca\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.524166 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.524144 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4849299-08b5-4025-a67d-d8a83fe5cf22-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.524712 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.524692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4849299-08b5-4025-a67d-d8a83fe5cf22-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.525196 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.525170 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.525303 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.525245 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e30a2ea8-5137-4dbc-8644-ba8623a34146-node-exporter-tls\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.528814 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.528775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s559n\" (UniqueName: \"kubernetes.io/projected/f4849299-08b5-4025-a67d-d8a83fe5cf22-kube-api-access-s559n\") pod \"openshift-state-metrics-67dcf8c979-cnnw4\" (UID: \"f4849299-08b5-4025-a67d-d8a83fe5cf22\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.529373 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.529356 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jd75\" (UniqueName: \"kubernetes.io/projected/e30a2ea8-5137-4dbc-8644-ba8623a34146-kube-api-access-8jd75\") pod \"node-exporter-8zxwt\" (UID: \"e30a2ea8-5137-4dbc-8644-ba8623a34146\") " pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.552848 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.552830 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" Sep 17 02:48:50.584811 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.584693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8zxwt" Sep 17 02:48:50.598699 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:50.598664 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30a2ea8_5137_4dbc_8644_ba8623a34146.slice/crio-4d8f3127644f6c9cd2ddcc829596cf7a14365e08a34816154abfa5b1d7dc606c WatchSource:0}: Error finding container 4d8f3127644f6c9cd2ddcc829596cf7a14365e08a34816154abfa5b1d7dc606c: Status 404 returned error can't find the container with id 4d8f3127644f6c9cd2ddcc829596cf7a14365e08a34816154abfa5b1d7dc606c Sep 17 02:48:50.601938 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.601341 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 02:48:50.826194 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:50.826035 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4"] Sep 17 02:48:50.828554 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:50.828526 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4849299_08b5_4025_a67d_d8a83fe5cf22.slice/crio-6c75ee60290907f524dd3805d18da959c0728fb60875f58e727001b553d56937 WatchSource:0}: Error finding container 6c75ee60290907f524dd3805d18da959c0728fb60875f58e727001b553d56937: Status 404 returned error can't find the container with id 6c75ee60290907f524dd3805d18da959c0728fb60875f58e727001b553d56937 Sep 17 02:48:51.237655 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.237571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zxwt" event={"ID":"e30a2ea8-5137-4dbc-8644-ba8623a34146","Type":"ContainerStarted","Data":"4d8f3127644f6c9cd2ddcc829596cf7a14365e08a34816154abfa5b1d7dc606c"} Sep 17 02:48:51.240743 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.240715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" event={"ID":"f4849299-08b5-4025-a67d-d8a83fe5cf22","Type":"ContainerStarted","Data":"e8ffdab884b36d68c323d9cfa7adc5606aeb11ee5bc107eb68da45b1d00ad574"} Sep 17 02:48:51.240919 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.240772 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" event={"ID":"f4849299-08b5-4025-a67d-d8a83fe5cf22","Type":"ContainerStarted","Data":"7fc6159b7ca9d25c187054ef734662f04b727f0d3972789e489c7a2118060dcd"} Sep 17 02:48:51.240919 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.240824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" event={"ID":"f4849299-08b5-4025-a67d-d8a83fe5cf22","Type":"ContainerStarted","Data":"6c75ee60290907f524dd3805d18da959c0728fb60875f58e727001b553d56937"} Sep 17 02:48:51.320478 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.320438 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 02:48:51.324848 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.324821 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.327716 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.327690 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 02:48:51.328311 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.327945 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 02:48:51.328311 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.327958 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 02:48:51.330889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.328367 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 02:48:51.330889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.328571 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 02:48:51.330889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.328768 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 02:48:51.330889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.329018 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 02:48:51.330889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.329157 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 02:48:51.330889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.329584 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hzfkn\"" Sep 17 02:48:51.334913 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.334704 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 02:48:51.336252 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.336186 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 02:48:51.431427 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-out\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431427 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431664 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431664 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431664 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431664 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431902 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431902 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-volume\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431902 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431902 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.431902 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-web-config\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.432123 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.432123 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.431935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqgbb\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-kube-api-access-kqgbb\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533302 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533302 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-volume\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533514 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-web-config\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqgbb\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-kube-api-access-kqgbb\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-out\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.533763 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.533661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.534091 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:51.534056 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 17 02:48:51.534156 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:48:51.534124 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls podName:63f41ee6-0a96-4c53-8180-7de5a2ca80ec nodeName:}" failed. No retries permitted until 2026-09-17 02:48:52.034104468 +0000 UTC m=+303.169220796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec") : secret "alertmanager-main-tls" not found Sep 17 02:48:51.534834 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.534807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.535882 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.535855 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.537335 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.537308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.540050 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.540026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.540147 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.540056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-out\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.540397 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.540370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.540472 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.540455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-web-config\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.540831 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.540806 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.540921 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.540883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.542089 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.542064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.542261 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.542218 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-volume\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:51.544705 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:51.544681 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqgbb\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-kube-api-access-kqgbb\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:52.040139 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.040101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:52.042674 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.042648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:52.239679 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.239642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:48:52.246063 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.246035 2580 generic.go:356] "Generic (PLEG): container finished" podID="e30a2ea8-5137-4dbc-8644-ba8623a34146" containerID="20a81ddf4714a9ab4d2f7026430d3d2cfdfec86979c97975406d22741d2dc609" exitCode=0 Sep 17 02:48:52.246180 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.246125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zxwt" event={"ID":"e30a2ea8-5137-4dbc-8644-ba8623a34146","Type":"ContainerDied","Data":"20a81ddf4714a9ab4d2f7026430d3d2cfdfec86979c97975406d22741d2dc609"} Sep 17 02:48:52.344142 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.344120 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f966bb7f-d6jhj"] Sep 17 02:48:52.348817 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.348777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.351447 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.351419 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jn42n\"" Sep 17 02:48:52.351847 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.351826 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 02:48:52.351932 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.351910 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9oiqclj9s9n75\"" Sep 17 02:48:52.351988 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.351968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 02:48:52.352095 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.352054 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 02:48:52.352704 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.352685 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 02:48:52.352931 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.352916 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 02:48:52.358759 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.358737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f966bb7f-d6jhj"] Sep 17 02:48:52.444140 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444296 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-grpc-tls\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444296 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-tls\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444296 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrr5d\" (UniqueName: \"kubernetes.io/projected/2d22171f-938f-4e81-a4fd-1daf43b70258-kube-api-access-hrr5d\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444296 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444296 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444465 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.444465 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.444320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d22171f-938f-4e81-a4fd-1daf43b70258-metrics-client-ca\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.533119 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.529180 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 02:48:52.545309 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-grpc-tls\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545396 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-tls\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545396 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrr5d\" (UniqueName: \"kubernetes.io/projected/2d22171f-938f-4e81-a4fd-1daf43b70258-kube-api-access-hrr5d\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545396 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545525 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545525 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545525 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d22171f-938f-4e81-a4fd-1daf43b70258-metrics-client-ca\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.545686 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.545565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.546430 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.546339 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d22171f-938f-4e81-a4fd-1daf43b70258-metrics-client-ca\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.548104 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.548054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-tls\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.548258 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.548239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-grpc-tls\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.548324 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.548268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.548452 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.548429 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.548488 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.548448 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.548488 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.548441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d22171f-938f-4e81-a4fd-1daf43b70258-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.551997 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.551979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrr5d\" (UniqueName: \"kubernetes.io/projected/2d22171f-938f-4e81-a4fd-1daf43b70258-kube-api-access-hrr5d\") pod \"thanos-querier-7f966bb7f-d6jhj\" (UID: \"2d22171f-938f-4e81-a4fd-1daf43b70258\") " pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.671334 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.671312 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:52.942365 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:52.942331 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f966bb7f-d6jhj"] Sep 17 02:48:52.946027 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:52.946003 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d22171f_938f_4e81_a4fd_1daf43b70258.slice/crio-4c10f545160b2b2fdd3fd4927edf1a416d0a9e9098ab5fb59c451b3a732feff9 WatchSource:0}: Error finding container 4c10f545160b2b2fdd3fd4927edf1a416d0a9e9098ab5fb59c451b3a732feff9: Status 404 returned error can't find the container with id 4c10f545160b2b2fdd3fd4927edf1a416d0a9e9098ab5fb59c451b3a732feff9 Sep 17 02:48:53.257137 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.257048 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zxwt" event={"ID":"e30a2ea8-5137-4dbc-8644-ba8623a34146","Type":"ContainerStarted","Data":"b70c89c1bf9c8cc387f341d437d2bb336263c1dc83a50388f747bb6748cd961f"} Sep 17 02:48:53.257137 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.257112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zxwt" event={"ID":"e30a2ea8-5137-4dbc-8644-ba8623a34146","Type":"ContainerStarted","Data":"d9cc198834d8d723e3190ef270105c5f6075df226b43858e52e147f1d2984a13"} Sep 17 02:48:53.259000 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.258974 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"4c10f545160b2b2fdd3fd4927edf1a416d0a9e9098ab5fb59c451b3a732feff9"} Sep 17 02:48:53.260921 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.260893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"1cac2322e119387661e2852a98a021277c642d2b4fd7646241902bb1caf9f44d"} Sep 17 02:48:53.263579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.263549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" event={"ID":"f4849299-08b5-4025-a67d-d8a83fe5cf22","Type":"ContainerStarted","Data":"cee04b4f8a8d8d36933faebab9c3d2870b9911e133e6d57c6d94aa4484752541"} Sep 17 02:48:53.286537 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.286432 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8zxwt" podStartSLOduration=2.161917057 podStartE2EDuration="3.286414004s" totalImagesPullingTime="1.064724616s" totalInitContainerRuntime="59.772331ms" isStatefulPod=true podCreationTimestamp="2026-09-17 02:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:53.285514773 +0000 UTC m=+304.420631120" watchObservedRunningTime="2026-09-17 02:48:53.286414004 +0000 UTC m=+304.421530346" Sep 17 02:48:53.315186 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.315140 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cnnw4" podStartSLOduration=2.010232984 podStartE2EDuration="3.315125825s" totalImagesPullingTime="1.304892841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:53.314641784 +0000 UTC m=+304.449758128" watchObservedRunningTime="2026-09-17 02:48:53.315125825 +0000 UTC m=+304.450242168" Sep 17 02:48:53.455202 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.455164 2580 patch_prober.go:28] interesting pod/image-registry-8648ff99b-tz2hs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 02:48:53.455652 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:53.455228 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 02:48:54.271498 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:54.271465 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2" exitCode=0 Sep 17 02:48:54.271702 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:54.271579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2"} Sep 17 02:48:55.165929 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:55.165840 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:48:55.320591 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:55.320550 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:48:56.154390 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.154316 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8648ff99b-tz2hs"] Sep 17 02:48:56.282897 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.282859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"e68fe2283cbd6218fc64e2a4633f3ee52d2b03d93111737137ae32b84cfc1638"} Sep 17 02:48:56.283343 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.282939 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"f1d30e95228b0f596225ffc61ad4fbe19b59341f2483957594ed1ecf14fb6580"} Sep 17 02:48:56.283343 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.283015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"926acf50323f6d326f62f0f3a685106ed5c797e40b92708955d961f0e02c0f78"} Sep 17 02:48:56.286120 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.286094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000"} Sep 17 02:48:56.286233 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.286153 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d"} Sep 17 02:48:56.286233 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.286181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4"} Sep 17 02:48:56.286233 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.286206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12"} Sep 17 02:48:56.286328 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.286253 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d"} Sep 17 02:48:56.566769 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.566738 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:48:56.573118 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.573086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.576087 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.576060 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 02:48:56.576263 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.576241 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 02:48:56.576527 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.576495 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 02:48:56.576527 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.576503 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 02:48:56.576773 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.576744 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 02:48:56.576878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.576829 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 02:48:56.579234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.577554 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 02:48:56.579234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.578710 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8hlfj\"" Sep 17 02:48:56.579234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.578913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 02:48:56.579234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.579077 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 02:48:56.579647 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.579243 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 02:48:56.579647 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.579324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4a6crilelcn5m\"" Sep 17 02:48:56.579647 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.579487 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 02:48:56.579647 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.579498 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 02:48:56.579858 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.579776 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 02:48:56.581292 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.581271 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 02:48:56.583170 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.583147 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 02:48:56.588139 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.588114 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:48:56.684154 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684337 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684337 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684337 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684337 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684337 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2z2\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-kube-api-access-9x2z2\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684535 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.684717 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.685032 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.685032 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.684833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-config\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-config\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2z2\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-kube-api-access-9x2z2\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.786628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.787550 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.786622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.787603 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.787583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.788119 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.787727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.788119 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.787766 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.788119 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.787804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.788530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.788503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.788626 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.788615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.791854 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.791829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.791982 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.791885 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.792037 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.791996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.792262 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.792238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.792346 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.792296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.793486 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.792656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.793486 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.792973 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.793486 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.793324 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.794291 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.794260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.795277 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.795234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.795973 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.795933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.796136 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.796116 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.796628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.796494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.796628 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.796515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.796917 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.796876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-config\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.800409 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.800386 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2z2\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-kube-api-access-9x2z2\") pod \"prometheus-k8s-0\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:56.888254 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:56.888163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:48:57.176292 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.176266 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:48:57.178549 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:48:57.178524 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a1ef66_d068_460d_afee_7ffd1c601fb7.slice/crio-d152077f9f1f946fb7cc4f46efb68248e16b4a54dd837e3e5d48b4d760e6a6a7 WatchSource:0}: Error finding container d152077f9f1f946fb7cc4f46efb68248e16b4a54dd837e3e5d48b4d760e6a6a7: Status 404 returned error can't find the container with id d152077f9f1f946fb7cc4f46efb68248e16b4a54dd837e3e5d48b4d760e6a6a7 Sep 17 02:48:57.291249 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.291224 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" exitCode=0 Sep 17 02:48:57.291567 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.291304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} Sep 17 02:48:57.291567 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.291367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"d152077f9f1f946fb7cc4f46efb68248e16b4a54dd837e3e5d48b4d760e6a6a7"} Sep 17 02:48:57.293777 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.293756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"a43cd4f39a94e522eeae3cb2646cb17f9c7286063574766d895eae00cfdb0efd"} Sep 17 02:48:57.302656 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.302633 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerStarted","Data":"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084"} Sep 17 02:48:57.345905 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:57.345862 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.699061625 podStartE2EDuration="6.345845507s" totalImagesPullingTime="3.630791933s" totalInitContainerRuntime="15.991949ms" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:57.344239577 +0000 UTC m=+308.479355932" watchObservedRunningTime="2026-09-17 02:48:57.345845507 +0000 UTC m=+308.480961851" Sep 17 02:48:58.311055 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:58.311017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"613d0a84b9494cccc6516e703a5a861e47a844529bbb26c8d282004f03729e95"} Sep 17 02:48:58.311521 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:58.311092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" event={"ID":"2d22171f-938f-4e81-a4fd-1daf43b70258","Type":"ContainerStarted","Data":"cfd44572671a9b8c003f91341659260dfe8a66927d06b757685b1f17aa0dd9dc"} Sep 17 02:48:58.311521 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:58.311230 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:48:58.334137 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:48:58.334079 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" podStartSLOduration=2.335274618 podStartE2EDuration="6.334057375s" totalImagesPullingTime="3.998782757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:48:58.332605372 +0000 UTC m=+309.467721717" watchObservedRunningTime="2026-09-17 02:48:58.334057375 +0000 UTC m=+309.469173718" Sep 17 02:49:01.335026 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.334991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} Sep 17 02:49:01.335401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.335063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} Sep 17 02:49:01.335401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.335091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} Sep 17 02:49:01.335401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.335115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} Sep 17 02:49:01.335401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.335145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} Sep 17 02:49:01.335401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.335169 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerStarted","Data":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} Sep 17 02:49:01.366059 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.365980 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.261783703 podStartE2EDuration="5.365962743s" totalImagesPullingTime="3.081413121s" totalInitContainerRuntime="22.765919ms" isStatefulPod=false podCreationTimestamp="2026-09-17 02:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:49:01.364280682 +0000 UTC m=+312.499397025" watchObservedRunningTime="2026-09-17 02:49:01.365962743 +0000 UTC m=+312.501079079" Sep 17 02:49:01.888884 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:01.888843 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:49:04.322104 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:04.322072 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f966bb7f-d6jhj" Sep 17 02:49:21.174718 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.174626 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" containerName="registry" containerID="cri-o://6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde" gracePeriod=30 Sep 17 02:49:21.416632 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.416601 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:49:21.422816 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.422771 2580 generic.go:356] "Generic (PLEG): container finished" podID="92801ed5-a854-46b7-8821-9a0a952ded5a" containerID="6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde" exitCode=0 Sep 17 02:49:21.422935 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.422826 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" Sep 17 02:49:21.422935 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.422854 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" event={"ID":"92801ed5-a854-46b7-8821-9a0a952ded5a","Type":"ContainerDied","Data":"6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde"} Sep 17 02:49:21.422935 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.422898 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8648ff99b-tz2hs" event={"ID":"92801ed5-a854-46b7-8821-9a0a952ded5a","Type":"ContainerDied","Data":"0fa20ec74687c276be60170f1786354d5973bad96b986a4c1428140c73bc3389"} Sep 17 02:49:21.422935 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.422921 2580 scope.go:117] "RemoveContainer" containerID="6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde" Sep 17 02:49:21.424366 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.424349 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72e942f-db8e-48e2-8e44-b8d0af99166b" containerID="db09134e6de4467731348728dce842b56bf44fde35511814f988c38708f75471" exitCode=0 Sep 17 02:49:21.424447 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.424420 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hcfz6" event={"ID":"b72e942f-db8e-48e2-8e44-b8d0af99166b","Type":"ContainerDied","Data":"db09134e6de4467731348728dce842b56bf44fde35511814f988c38708f75471"} Sep 17 02:49:21.424682 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.424669 2580 scope.go:117] "RemoveContainer" containerID="db09134e6de4467731348728dce842b56bf44fde35511814f988c38708f75471" Sep 17 02:49:21.433861 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.433846 2580 scope.go:117] "RemoveContainer" containerID="6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde" Sep 17 02:49:21.434155 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:49:21.434130 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde\": container with ID starting with 6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde not found: ID does not exist" containerID="6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde" Sep 17 02:49:21.434208 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.434167 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde"} err="failed to get container status \"6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde\": rpc error: code = NotFound desc = could not find container \"6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde\": container with ID starting with 6de693e05ad61e87fd5971b3dfa0dbe991ee479e4508b099e8ed62e65e5fffde not found: ID does not exist" Sep 17 02:49:21.521317 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521285 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7w49\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-kube-api-access-q7w49\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521466 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521326 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-certificates\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521466 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521354 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-image-registry-private-configuration\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521466 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521385 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521466 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521425 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92801ed5-a854-46b7-8821-9a0a952ded5a-ca-trust-extracted\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521466 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521446 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-bound-sa-token\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521797 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521480 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-installation-pull-secrets\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521797 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521531 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-trusted-ca\") pod \"92801ed5-a854-46b7-8821-9a0a952ded5a\" (UID: \"92801ed5-a854-46b7-8821-9a0a952ded5a\") " Sep 17 02:49:21.521906 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521827 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:49:21.521968 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.521951 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-certificates\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.522742 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.522694 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:49:21.523858 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.523836 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:49:21.524198 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.524175 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:49:21.524198 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.524182 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-kube-api-access-q7w49" (OuterVolumeSpecName: "kube-api-access-q7w49") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "kube-api-access-q7w49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:49:21.524474 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.524450 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:49:21.524918 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.524896 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:49:21.530943 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.530915 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92801ed5-a854-46b7-8821-9a0a952ded5a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "92801ed5-a854-46b7-8821-9a0a952ded5a" (UID: "92801ed5-a854-46b7-8821-9a0a952ded5a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 02:49:21.623240 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623209 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-image-registry-private-configuration\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.623240 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623237 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-registry-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.623438 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623249 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92801ed5-a854-46b7-8821-9a0a952ded5a-ca-trust-extracted\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.623438 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623262 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-bound-sa-token\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.623438 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623275 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92801ed5-a854-46b7-8821-9a0a952ded5a-installation-pull-secrets\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.623438 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623285 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92801ed5-a854-46b7-8821-9a0a952ded5a-trusted-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.623438 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.623297 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7w49\" (UniqueName: \"kubernetes.io/projected/92801ed5-a854-46b7-8821-9a0a952ded5a-kube-api-access-q7w49\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:49:21.746411 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.746376 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8648ff99b-tz2hs"] Sep 17 02:49:21.750119 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:21.750095 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8648ff99b-tz2hs"] Sep 17 02:49:22.430371 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:22.430333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hcfz6" event={"ID":"b72e942f-db8e-48e2-8e44-b8d0af99166b","Type":"ContainerStarted","Data":"e542c1787ae8e38fe9a75bca0a24beedc77f1ff0efb19ce10cb7dc323da74015"} Sep 17 02:49:23.326031 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:23.325992 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" path="/var/lib/kubelet/pods/92801ed5-a854-46b7-8821-9a0a952ded5a/volumes" Sep 17 02:49:41.521188 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:41.521151 2580 generic.go:356] "Generic (PLEG): container finished" podID="f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a" containerID="2e3780017137544739a53ed5fcafd361704551c0a402202a6419a01953039617" exitCode=0 Sep 17 02:49:41.521709 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:41.521234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" event={"ID":"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a","Type":"ContainerDied","Data":"2e3780017137544739a53ed5fcafd361704551c0a402202a6419a01953039617"} Sep 17 02:49:41.521709 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:41.521645 2580 scope.go:117] "RemoveContainer" containerID="2e3780017137544739a53ed5fcafd361704551c0a402202a6419a01953039617" Sep 17 02:49:42.527550 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:42.527510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-v52nt" event={"ID":"f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a","Type":"ContainerStarted","Data":"c3ec7953a0ac65f565665f0df9aad5cb7dc4bf2b2f1367faa5b6483eb8df6f02"} Sep 17 02:49:56.888377 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:56.888338 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:49:56.907706 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:56.907677 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:49:57.603131 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:49:57.603105 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:03.281897 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:03.281848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:50:03.284247 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:03.284220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed18f6dd-2d32-4ec6-8a72-333b52cb92f6-metrics-certs\") pod \"network-metrics-daemon-png44\" (UID: \"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6\") " pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:50:03.424641 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:03.424612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-742gf\"" Sep 17 02:50:03.432770 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:03.432750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-png44" Sep 17 02:50:03.701714 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:03.701685 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-png44"] Sep 17 02:50:03.703846 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:50:03.703821 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded18f6dd_2d32_4ec6_8a72_333b52cb92f6.slice/crio-74cff34a44260ff1d0169aee2ab69be8ac117e333b643762d7716b5a9d114187 WatchSource:0}: Error finding container 74cff34a44260ff1d0169aee2ab69be8ac117e333b643762d7716b5a9d114187: Status 404 returned error can't find the container with id 74cff34a44260ff1d0169aee2ab69be8ac117e333b643762d7716b5a9d114187 Sep 17 02:50:04.616388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:04.616346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-png44" event={"ID":"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6","Type":"ContainerStarted","Data":"74cff34a44260ff1d0169aee2ab69be8ac117e333b643762d7716b5a9d114187"} Sep 17 02:50:05.622136 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:05.622091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-png44" event={"ID":"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6","Type":"ContainerStarted","Data":"806e0b861e8dbd57d2fe0b15c41f1438f1510c831ce959880a867f58c9aee14c"} Sep 17 02:50:05.622496 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:05.622185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-png44" event={"ID":"ed18f6dd-2d32-4ec6-8a72-333b52cb92f6","Type":"ContainerStarted","Data":"63147ee1f4c8561298e245c33160e0f3eabdf7a1249daee5009619beef56950f"} Sep 17 02:50:05.639578 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:05.639529 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-png44" podStartSLOduration=375.367152945 podStartE2EDuration="6m16.63951357s" totalImagesPullingTime="1.272360625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:50:05.637505447 +0000 UTC m=+376.772621794" watchObservedRunningTime="2026-09-17 02:50:05.63951357 +0000 UTC m=+376.774629919" Sep 17 02:50:10.726994 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.726962 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 02:50:10.727533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.727221 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="alertmanager" containerID="cri-o://9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d" gracePeriod=120 Sep 17 02:50:10.727533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.727283 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-metric" containerID="cri-o://4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000" gracePeriod=120 Sep 17 02:50:10.727533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.727297 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-web" containerID="cri-o://aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4" gracePeriod=120 Sep 17 02:50:10.727533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.727312 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="config-reloader" containerID="cri-o://483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12" gracePeriod=120 Sep 17 02:50:10.727533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.727387 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="prom-label-proxy" containerID="cri-o://eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084" gracePeriod=120 Sep 17 02:50:10.727533 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:10.727380 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy" containerID="cri-o://3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d" gracePeriod=120 Sep 17 02:50:11.651388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651355 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084" exitCode=0 Sep 17 02:50:11.651388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651382 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d" exitCode=0 Sep 17 02:50:11.651388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651390 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12" exitCode=0 Sep 17 02:50:11.651388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651397 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d" exitCode=0 Sep 17 02:50:11.651654 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084"} Sep 17 02:50:11.651654 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651496 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d"} Sep 17 02:50:11.651654 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12"} Sep 17 02:50:11.651654 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.651551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d"} Sep 17 02:50:11.965333 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:11.965309 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:50:12.056457 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056429 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqgbb\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-kube-api-access-kqgbb\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056469 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-trusted-ca-bundle\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056491 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-volume\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056613 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056507 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056747 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056679 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-web-config\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056747 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056733 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-tls-assets\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056768 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056878 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056821 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056986 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056880 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-cluster-tls-config\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056986 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056906 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:12.056986 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056926 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-main-db\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056986 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056954 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-out\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.056986 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.056986 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-metrics-client-ca\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.057239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.057022 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\" (UID: \"63f41ee6-0a96-4c53-8180-7de5a2ca80ec\") " Sep 17 02:50:12.057298 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.057287 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.057721 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.057360 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 02:50:12.058072 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.058045 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:12.059454 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.059395 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.059557 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.059517 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-volume" (OuterVolumeSpecName: "config-volume") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.059719 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.059689 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.060085 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.060057 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.060388 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.060361 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:50:12.060470 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.060402 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-kube-api-access-kqgbb" (OuterVolumeSpecName: "kube-api-access-kqgbb") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "kube-api-access-kqgbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:50:12.060917 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.060895 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-out" (OuterVolumeSpecName: "config-out") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 02:50:12.061323 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.061305 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.064597 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.064575 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.071303 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.071283 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-web-config" (OuterVolumeSpecName: "web-config") pod "63f41ee6-0a96-4c53-8180-7de5a2ca80ec" (UID: "63f41ee6-0a96-4c53-8180-7de5a2ca80ec"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:12.157796 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157756 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-cluster-tls-config\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157821 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-alertmanager-main-db\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157835 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-out\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157845 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-metrics-client-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157855 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157865 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqgbb\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-kube-api-access-kqgbb\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157873 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157882 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157890 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-web-config\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157898 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-tls-assets\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157906 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.157962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.157914 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63f41ee6-0a96-4c53-8180-7de5a2ca80ec-secret-alertmanager-main-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:12.659503 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659464 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000" exitCode=0 Sep 17 02:50:12.659503 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659496 2580 generic.go:356] "Generic (PLEG): container finished" podID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerID="aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4" exitCode=0 Sep 17 02:50:12.659704 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659499 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000"} Sep 17 02:50:12.659704 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659552 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 02:50:12.659704 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4"} Sep 17 02:50:12.659704 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659597 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63f41ee6-0a96-4c53-8180-7de5a2ca80ec","Type":"ContainerDied","Data":"1cac2322e119387661e2852a98a021277c642d2b4fd7646241902bb1caf9f44d"} Sep 17 02:50:12.659704 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.659630 2580 scope.go:117] "RemoveContainer" containerID="eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084" Sep 17 02:50:12.667463 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.667446 2580 scope.go:117] "RemoveContainer" containerID="4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000" Sep 17 02:50:12.675158 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.675141 2580 scope.go:117] "RemoveContainer" containerID="3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d" Sep 17 02:50:12.681918 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.681900 2580 scope.go:117] "RemoveContainer" containerID="aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4" Sep 17 02:50:12.684606 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.684580 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 02:50:12.689404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.689386 2580 scope.go:117] "RemoveContainer" containerID="483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12" Sep 17 02:50:12.690393 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.690377 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 02:50:12.696602 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.696585 2580 scope.go:117] "RemoveContainer" containerID="9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d" Sep 17 02:50:12.703577 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.703559 2580 scope.go:117] "RemoveContainer" containerID="d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2" Sep 17 02:50:12.711851 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.711829 2580 scope.go:117] "RemoveContainer" containerID="eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084" Sep 17 02:50:12.712340 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.712213 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084\": container with ID starting with eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084 not found: ID does not exist" containerID="eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084" Sep 17 02:50:12.712340 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.712248 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084"} err="failed to get container status \"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084\": rpc error: code = NotFound desc = could not find container \"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084\": container with ID starting with eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084 not found: ID does not exist" Sep 17 02:50:12.712340 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.712273 2580 scope.go:117] "RemoveContainer" containerID="4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000" Sep 17 02:50:12.712694 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.712583 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000\": container with ID starting with 4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000 not found: ID does not exist" containerID="4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000" Sep 17 02:50:12.712694 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.712610 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000"} err="failed to get container status \"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000\": rpc error: code = NotFound desc = could not find container \"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000\": container with ID starting with 4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000 not found: ID does not exist" Sep 17 02:50:12.712694 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.712629 2580 scope.go:117] "RemoveContainer" containerID="3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d" Sep 17 02:50:12.713309 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.713283 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d\": container with ID starting with 3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d not found: ID does not exist" containerID="3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d" Sep 17 02:50:12.713405 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.713310 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d"} err="failed to get container status \"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d\": rpc error: code = NotFound desc = could not find container \"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d\": container with ID starting with 3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d not found: ID does not exist" Sep 17 02:50:12.713405 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.713326 2580 scope.go:117] "RemoveContainer" containerID="aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4" Sep 17 02:50:12.713623 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.713605 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4\": container with ID starting with aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4 not found: ID does not exist" containerID="aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4" Sep 17 02:50:12.713671 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.713629 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4"} err="failed to get container status \"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4\": rpc error: code = NotFound desc = could not find container \"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4\": container with ID starting with aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4 not found: ID does not exist" Sep 17 02:50:12.713671 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.713645 2580 scope.go:117] "RemoveContainer" containerID="483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12" Sep 17 02:50:12.713927 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.713908 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12\": container with ID starting with 483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12 not found: ID does not exist" containerID="483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12" Sep 17 02:50:12.713988 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.713934 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12"} err="failed to get container status \"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12\": rpc error: code = NotFound desc = could not find container \"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12\": container with ID starting with 483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12 not found: ID does not exist" Sep 17 02:50:12.713988 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.713951 2580 scope.go:117] "RemoveContainer" containerID="9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d" Sep 17 02:50:12.714209 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.714193 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d\": container with ID starting with 9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d not found: ID does not exist" containerID="9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d" Sep 17 02:50:12.714256 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.714211 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d"} err="failed to get container status \"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d\": rpc error: code = NotFound desc = could not find container \"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d\": container with ID starting with 9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d not found: ID does not exist" Sep 17 02:50:12.714256 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.714223 2580 scope.go:117] "RemoveContainer" containerID="d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2" Sep 17 02:50:12.714442 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:12.714428 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2\": container with ID starting with d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2 not found: ID does not exist" containerID="d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2" Sep 17 02:50:12.714485 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.714445 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2"} err="failed to get container status \"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2\": rpc error: code = NotFound desc = could not find container \"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2\": container with ID starting with d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2 not found: ID does not exist" Sep 17 02:50:12.714485 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.714456 2580 scope.go:117] "RemoveContainer" containerID="eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084" Sep 17 02:50:12.714793 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.714757 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084"} err="failed to get container status \"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084\": rpc error: code = NotFound desc = could not find container \"eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084\": container with ID starting with eaee057270f9ab16fdff7ad478b00eaf788a859d5f911de53a846af6242f2084 not found: ID does not exist" Sep 17 02:50:12.714852 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.714820 2580 scope.go:117] "RemoveContainer" containerID="4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000" Sep 17 02:50:12.715094 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715076 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000"} err="failed to get container status \"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000\": rpc error: code = NotFound desc = could not find container \"4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000\": container with ID starting with 4e4432fcf5e36000902e3b48ad12c0a26c747ffde73ce53188f8e3a723f43000 not found: ID does not exist" Sep 17 02:50:12.715163 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715096 2580 scope.go:117] "RemoveContainer" containerID="3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d" Sep 17 02:50:12.715358 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715340 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d"} err="failed to get container status \"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d\": rpc error: code = NotFound desc = could not find container \"3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d\": container with ID starting with 3ab29af547cf9a2ca3b82c66bfa4ab9530a8b96145632d65746f4b6b9608de4d not found: ID does not exist" Sep 17 02:50:12.715410 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715358 2580 scope.go:117] "RemoveContainer" containerID="aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4" Sep 17 02:50:12.715572 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715554 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4"} err="failed to get container status \"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4\": rpc error: code = NotFound desc = could not find container \"aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4\": container with ID starting with aa8a5bbc8eb3f3827c762386f5c62aab9e9fac15fb135ff580cf0f83100dbfc4 not found: ID does not exist" Sep 17 02:50:12.715643 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715575 2580 scope.go:117] "RemoveContainer" containerID="483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12" Sep 17 02:50:12.715916 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715890 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12"} err="failed to get container status \"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12\": rpc error: code = NotFound desc = could not find container \"483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12\": container with ID starting with 483b59fde81debd55f4df755478187266a213ca7babbc54365bb3c1070c26a12 not found: ID does not exist" Sep 17 02:50:12.715985 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.715923 2580 scope.go:117] "RemoveContainer" containerID="9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d" Sep 17 02:50:12.716205 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.716175 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d"} err="failed to get container status \"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d\": rpc error: code = NotFound desc = could not find container \"9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d\": container with ID starting with 9655c22e64097a4e1b171c427bdfe9ba340ce1da0464baa9344a949b9904a73d not found: ID does not exist" Sep 17 02:50:12.716258 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.716213 2580 scope.go:117] "RemoveContainer" containerID="d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2" Sep 17 02:50:12.716481 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:12.716451 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2"} err="failed to get container status \"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2\": rpc error: code = NotFound desc = could not find container \"d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2\": container with ID starting with d41e05747f2676b3a91bbeecc196f741219189fd9ad5da646a8f5b9f0be49bc2 not found: ID does not exist" Sep 17 02:50:13.326454 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:13.326424 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" path="/var/lib/kubelet/pods/63f41ee6-0a96-4c53-8180-7de5a2ca80ec/volumes" Sep 17 02:50:14.945622 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.945587 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:50:14.946021 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.945930 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="prometheus" containerID="cri-o://bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" gracePeriod=600 Sep 17 02:50:14.946021 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.945945 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy" containerID="cri-o://e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" gracePeriod=600 Sep 17 02:50:14.946145 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.945989 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="thanos-sidecar" containerID="cri-o://ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" gracePeriod=600 Sep 17 02:50:14.946145 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.946031 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="config-reloader" containerID="cri-o://350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" gracePeriod=600 Sep 17 02:50:14.946145 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.946036 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" gracePeriod=600 Sep 17 02:50:14.946294 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:14.946162 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-web" containerID="cri-o://424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" gracePeriod=600 Sep 17 02:50:15.202305 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.201970 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.279768 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279738 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-config-out\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.279768 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279774 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-thanos-prometheus-http-client-file\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280018 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279823 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x2z2\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-kube-api-access-9x2z2\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280018 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279846 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-db\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280018 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279866 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-trusted-ca-bundle\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280018 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279887 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-metrics-client-ca\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280018 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.279905 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-grpc-tls\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280328 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280233 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.280387 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280359 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.280439 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280417 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280492 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280448 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-1\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280492 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280476 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-serving-certs-ca-bundle\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280592 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-tls-assets\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280592 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280558 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-metrics-client-certs\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280592 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280581 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-config\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280736 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280609 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-0\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280736 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280648 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-tls\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280736 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280675 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-kubelet-serving-ca-bundle\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280903 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280735 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-kube-rbac-proxy\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280903 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280767 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-2\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280903 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280777 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.280903 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280808 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-web-config\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.280903 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.280863 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"68a1ef66-d068-460d-afee-7ffd1c601fb7\" (UID: \"68a1ef66-d068-460d-afee-7ffd1c601fb7\") " Sep 17 02:50:15.281148 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.281125 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.281199 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.281145 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-metrics-client-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.281199 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.281162 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.282495 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.282591 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-kube-api-access-9x2z2" (OuterVolumeSpecName: "kube-api-access-9x2z2") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "kube-api-access-9x2z2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.282712 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.283301 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.283491 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.283832 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.284078 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-config-out" (OuterVolumeSpecName: "config-out") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.284215 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.285182 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.285619 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:50:15.287579 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.285757 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.291246 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.290419 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.291246 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.290523 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.292561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.292535 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.292561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.292546 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.293230 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.293209 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-config" (OuterVolumeSpecName: "config") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.301552 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.301524 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-web-config" (OuterVolumeSpecName: "web-config") pod "68a1ef66-d068-460d-afee-7ffd1c601fb7" (UID: "68a1ef66-d068-460d-afee-7ffd1c601fb7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 02:50:15.382412 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382385 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-kube-rbac-proxy\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382412 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382407 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382435 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-web-config\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382445 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382454 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-config-out\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382463 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382471 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x2z2\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-kube-api-access-9x2z2\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382479 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-db\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382488 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-grpc-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382496 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382504 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382513 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68a1ef66-d068-460d-afee-7ffd1c601fb7-tls-assets\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382521 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-metrics-client-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382529 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-config\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382537 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382545 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382545 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68a1ef66-d068-460d-afee-7ffd1c601fb7-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.382989 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.382553 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68a1ef66-d068-460d-afee-7ffd1c601fb7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:50:15.676069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.675985 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" exitCode=0 Sep 17 02:50:15.676069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676012 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" exitCode=0 Sep 17 02:50:15.676069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676020 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" exitCode=0 Sep 17 02:50:15.676069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676025 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" exitCode=0 Sep 17 02:50:15.676069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676031 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" exitCode=0 Sep 17 02:50:15.676069 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676036 2580 generic.go:356] "Generic (PLEG): container finished" podID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" exitCode=0 Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676071 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676085 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676235 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} Sep 17 02:50:15.676336 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.676307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68a1ef66-d068-460d-afee-7ffd1c601fb7","Type":"ContainerDied","Data":"d152077f9f1f946fb7cc4f46efb68248e16b4a54dd837e3e5d48b4d760e6a6a7"} Sep 17 02:50:15.684070 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.684047 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.690992 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.690978 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.696946 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.696923 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:50:15.698277 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.698262 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.703827 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.703805 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:50:15.705249 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.705234 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.711839 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.711821 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.718804 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.718773 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.725306 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.725285 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.725642 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.725618 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.725715 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.725652 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} err="failed to get container status \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" Sep 17 02:50:15.725715 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.725676 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.726171 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.726153 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.726246 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726178 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} err="failed to get container status \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" Sep 17 02:50:15.726246 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726199 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.726465 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.726446 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.726527 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726471 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} err="failed to get container status \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" Sep 17 02:50:15.726527 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726491 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.726732 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.726716 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.726823 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726737 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} err="failed to get container status \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" Sep 17 02:50:15.726823 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726756 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.727006 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.726990 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.727061 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727017 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} err="failed to get container status \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" Sep 17 02:50:15.727061 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727036 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.727148 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.726996 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:50:15.727255 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.727240 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.727342 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727261 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} err="failed to get container status \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" Sep 17 02:50:15.727342 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727277 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727359 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="config-reloader" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727370 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="config-reloader" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727389 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="init-config-reloader" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727395 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="init-config-reloader" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727403 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-web" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727410 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-web" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727427 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-metric" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727433 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-metric" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727440 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="thanos-sidecar" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727445 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="thanos-sidecar" Sep 17 02:50:15.727448 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727452 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="config-reloader" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727458 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="config-reloader" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727465 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="init-config-reloader" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727474 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="init-config-reloader" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727483 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727489 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727496 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727501 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: E0917 02:50:15.727495 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727511 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="prom-label-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727516 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="prom-label-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727524 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-thanos" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727520 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} err="failed to get container status \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727542 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727529 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-thanos" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727599 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="alertmanager" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727607 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="alertmanager" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727617 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" containerName="registry" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727622 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" containerName="registry" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727629 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="prometheus" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727635 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="prometheus" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727641 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-web" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727647 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-web" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727717 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="thanos-sidecar" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727725 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-web" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727737 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy-thanos" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727744 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="config-reloader" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727750 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727755 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="prometheus" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727760 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="config-reloader" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727766 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="prom-label-proxy" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727771 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-web" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727778 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="kube-rbac-proxy-metric" Sep 17 02:50:15.727856 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727799 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="92801ed5-a854-46b7-8821-9a0a952ded5a" containerName="registry" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727807 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" containerName="kube-rbac-proxy" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727815 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f41ee6-0a96-4c53-8180-7de5a2ca80ec" containerName="alertmanager" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727867 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} err="failed to get container status \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.727886 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728099 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} err="failed to get container status \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728114 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728323 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} err="failed to get container status \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728338 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728600 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} err="failed to get container status \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728622 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728928 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} err="failed to get container status \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" Sep 17 02:50:15.729181 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.728945 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.729646 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.729194 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} err="failed to get container status \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" Sep 17 02:50:15.729646 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.729216 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.729646 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.729430 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} err="failed to get container status \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" Sep 17 02:50:15.729646 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.729445 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.729841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.729727 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} err="failed to get container status \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" Sep 17 02:50:15.729841 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.729745 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.730063 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730041 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} err="failed to get container status \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" Sep 17 02:50:15.730129 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730065 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.730301 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730285 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} err="failed to get container status \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" Sep 17 02:50:15.730366 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730302 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.730532 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730513 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} err="failed to get container status \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" Sep 17 02:50:15.730581 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730533 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.730803 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730763 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} err="failed to get container status \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" Sep 17 02:50:15.730803 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.730794 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.731021 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731004 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} err="failed to get container status \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" Sep 17 02:50:15.731021 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731020 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.731219 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731204 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} err="failed to get container status \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" Sep 17 02:50:15.731219 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731218 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.731414 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731398 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} err="failed to get container status \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" Sep 17 02:50:15.731469 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731414 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.731646 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731629 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} err="failed to get container status \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" Sep 17 02:50:15.731701 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731647 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.731904 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731885 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} err="failed to get container status \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" Sep 17 02:50:15.731996 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.731905 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.732144 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.732126 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} err="failed to get container status \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" Sep 17 02:50:15.732207 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.732146 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.732387 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.732370 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} err="failed to get container status \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" Sep 17 02:50:15.732428 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.732388 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.732798 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.732757 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} err="failed to get container status \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" Sep 17 02:50:15.732798 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.732795 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.733055 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.733035 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} err="failed to get container status \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" Sep 17 02:50:15.733055 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.733054 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.734931 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.733370 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.734931 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.733626 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} err="failed to get container status \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" Sep 17 02:50:15.734931 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.733648 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.735422 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.735386 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} err="failed to get container status \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" Sep 17 02:50:15.735422 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.735412 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.735737 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.735711 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} err="failed to get container status \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" Sep 17 02:50:15.735870 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.735738 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.736035 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736019 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} err="failed to get container status \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" Sep 17 02:50:15.736099 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736036 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.736278 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736248 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} err="failed to get container status \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" Sep 17 02:50:15.736278 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736269 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.736570 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736543 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} err="failed to get container status \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" Sep 17 02:50:15.736684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736573 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.736684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736599 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 02:50:15.736684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 02:50:15.736684 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736660 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736699 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736734 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.736645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737001 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} err="failed to get container status \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737023 2580 scope.go:117] "RemoveContainer" containerID="76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737056 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737118 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 02:50:15.737126 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737125 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737258 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff"} err="failed to get container status \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": rpc error: code = NotFound desc = could not find container \"76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff\": container with ID starting with 76af990a4db0d85f558faa47ff7b8f836bbd3a1f5027a869a9c352d2658fa3ff not found: ID does not exist" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737277 2580 scope.go:117] "RemoveContainer" containerID="e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737375 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737418 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8hlfj\"" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737377 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737475 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 02:50:15.737530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737546 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe"} err="failed to get container status \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": rpc error: code = NotFound desc = could not find container \"e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe\": container with ID starting with e24dc7d490809c12e6a55054ed856ff37cdad45a78442bcfc4c04b74c76f72fe not found: ID does not exist" Sep 17 02:50:15.738033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737570 2580 scope.go:117] "RemoveContainer" containerID="424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62" Sep 17 02:50:15.738033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737776 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4a6crilelcn5m\"" Sep 17 02:50:15.738033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737841 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62"} err="failed to get container status \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": rpc error: code = NotFound desc = could not find container \"424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62\": container with ID starting with 424f43a19442e4eaded8b1ac494bd9d1db20fcc7751c3a30bc8332aefca7fe62 not found: ID does not exist" Sep 17 02:50:15.738033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.737859 2580 scope.go:117] "RemoveContainer" containerID="ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825" Sep 17 02:50:15.738323 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738115 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825"} err="failed to get container status \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": rpc error: code = NotFound desc = could not find container \"ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825\": container with ID starting with ada11a59b1196cd9126cb5b46f04afdf7a0249f125ce6800887ca0c0b9931825 not found: ID does not exist" Sep 17 02:50:15.738323 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738139 2580 scope.go:117] "RemoveContainer" containerID="350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70" Sep 17 02:50:15.738323 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738306 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 02:50:15.738609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738477 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70"} err="failed to get container status \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": rpc error: code = NotFound desc = could not find container \"350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70\": container with ID starting with 350fabab3004b8f8674e864fd5651e368f1bfd4ffda18bb39c4e99183cfa1d70 not found: ID does not exist" Sep 17 02:50:15.738609 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738500 2580 scope.go:117] "RemoveContainer" containerID="bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e" Sep 17 02:50:15.738773 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738754 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e"} err="failed to get container status \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": rpc error: code = NotFound desc = could not find container \"bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e\": container with ID starting with bd6155f2361b46c0b371ad7250ee7d3e4a7af9b0ffaa60578bea76a92703ea5e not found: ID does not exist" Sep 17 02:50:15.738773 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.738772 2580 scope.go:117] "RemoveContainer" containerID="868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13" Sep 17 02:50:15.739071 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.739047 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13"} err="failed to get container status \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": rpc error: code = NotFound desc = could not find container \"868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13\": container with ID starting with 868aeca40ae7081e9214bc560ef94b506dac9faabbe63b0478774ce1dc2bfa13 not found: ID does not exist" Sep 17 02:50:15.739987 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.739951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 02:50:15.743028 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.743007 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 02:50:15.747730 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.747711 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:50:15.785885 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786025 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.785985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-config\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmvf\" (UniqueName: \"kubernetes.io/projected/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-kube-api-access-szmvf\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786239 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786509 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786509 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786509 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786509 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.786509 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.786357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886698 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-config\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886698 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szmvf\" (UniqueName: \"kubernetes.io/projected/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-kube-api-access-szmvf\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.886962 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.886996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887145 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887339 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.887847 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.887766 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.889460 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.888157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.889460 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.888778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.889460 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.889440 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.889902 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-config\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890084 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890100 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890121 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890130 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890427 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.890889 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.890533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.891141 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.891088 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.891732 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.891698 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.892171 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.892147 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.892435 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.892408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.892538 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.892514 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.892668 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.892625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.892773 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.892754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:15.894534 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:15.894510 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmvf\" (UniqueName: \"kubernetes.io/projected/e527d10c-03c6-4db4-a6fa-9da5fa6cd86d-kube-api-access-szmvf\") pod \"prometheus-k8s-0\" (UID: \"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:16.045008 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:16.044970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:50:16.323456 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:16.323428 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 02:50:16.324619 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:50:16.324591 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode527d10c_03c6_4db4_a6fa_9da5fa6cd86d.slice/crio-ffd7e8065d500c882b0bcc3c8cc562b70b55dfc1f47853b9c8ce8501dc78ca27 WatchSource:0}: Error finding container ffd7e8065d500c882b0bcc3c8cc562b70b55dfc1f47853b9c8ce8501dc78ca27: Status 404 returned error can't find the container with id ffd7e8065d500c882b0bcc3c8cc562b70b55dfc1f47853b9c8ce8501dc78ca27 Sep 17 02:50:16.683036 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:16.682950 2580 generic.go:356] "Generic (PLEG): container finished" podID="e527d10c-03c6-4db4-a6fa-9da5fa6cd86d" containerID="981b66f31ff38639761d56109796e902459a63df8ee467ae55588f4659161a29" exitCode=0 Sep 17 02:50:16.683036 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:16.683004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerDied","Data":"981b66f31ff38639761d56109796e902459a63df8ee467ae55588f4659161a29"} Sep 17 02:50:16.683199 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:16.683057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"ffd7e8065d500c882b0bcc3c8cc562b70b55dfc1f47853b9c8ce8501dc78ca27"} Sep 17 02:50:17.328650 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.328617 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a1ef66-d068-460d-afee-7ffd1c601fb7" path="/var/lib/kubelet/pods/68a1ef66-d068-460d-afee-7ffd1c601fb7/volumes" Sep 17 02:50:17.690688 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.690650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"c515aadea181e2c67da3483dfa89aeee380b1ea722edac33f8f1a6330626da46"} Sep 17 02:50:17.690892 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.690717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"690285a6c2bfda2df5c4c8c26f33a66a472f75ad2679d30a1443978c027dc25b"} Sep 17 02:50:17.690892 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.690752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"8748777c777893a19f31edfc9fb606067f181ac95fd11d0e9a64e47bdc62fe9b"} Sep 17 02:50:17.690892 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.690776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"15288df4273ed191760dffb3cd649d006c3a6ae51f569425b2ad7b1da6baefdd"} Sep 17 02:50:17.690892 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.690819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"c49d8bd5244b9e053f77940c5c3d9b91f6704add16e7c869ce20c920564e6f70"} Sep 17 02:50:17.690892 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.690849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e527d10c-03c6-4db4-a6fa-9da5fa6cd86d","Type":"ContainerStarted","Data":"c303551f5034c2bd3cf74179882581071569f9a0ba54e3e715c825337eba537f"} Sep 17 02:50:17.718195 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:17.718148 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.699157535 podStartE2EDuration="2.718132715s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.97518ms" isStatefulPod=false podCreationTimestamp="2026-09-17 02:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:50:17.715830433 +0000 UTC m=+388.850946777" watchObservedRunningTime="2026-09-17 02:50:17.718132715 +0000 UTC m=+388.853249059" Sep 17 02:50:21.045989 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:50:21.045943 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:51:16.045897 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:51:16.045814 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:51:16.061074 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:51:16.061049 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:51:16.937941 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:51:16.937912 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 02:52:11.480133 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.480100 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p78mx"] Sep 17 02:52:11.483265 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.483247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.485937 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.485911 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 02:52:11.487134 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.487116 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 02:52:11.487218 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.487120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4h6kt\"" Sep 17 02:52:11.494153 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.494130 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p78mx"] Sep 17 02:52:11.655851 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.655813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55c47\" (UniqueName: \"kubernetes.io/projected/e2ca5645-f7db-4af6-bc13-0fd406369a63-kube-api-access-55c47\") pod \"cert-manager-55b4d954d5-p78mx\" (UID: \"e2ca5645-f7db-4af6-bc13-0fd406369a63\") " pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.656020 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.655928 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2ca5645-f7db-4af6-bc13-0fd406369a63-bound-sa-token\") pod \"cert-manager-55b4d954d5-p78mx\" (UID: \"e2ca5645-f7db-4af6-bc13-0fd406369a63\") " pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.756991 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.756902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2ca5645-f7db-4af6-bc13-0fd406369a63-bound-sa-token\") pod \"cert-manager-55b4d954d5-p78mx\" (UID: \"e2ca5645-f7db-4af6-bc13-0fd406369a63\") " pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.756991 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.756947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55c47\" (UniqueName: \"kubernetes.io/projected/e2ca5645-f7db-4af6-bc13-0fd406369a63-kube-api-access-55c47\") pod \"cert-manager-55b4d954d5-p78mx\" (UID: \"e2ca5645-f7db-4af6-bc13-0fd406369a63\") " pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.764653 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.764616 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2ca5645-f7db-4af6-bc13-0fd406369a63-bound-sa-token\") pod \"cert-manager-55b4d954d5-p78mx\" (UID: \"e2ca5645-f7db-4af6-bc13-0fd406369a63\") " pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.764866 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.764846 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55c47\" (UniqueName: \"kubernetes.io/projected/e2ca5645-f7db-4af6-bc13-0fd406369a63-kube-api-access-55c47\") pod \"cert-manager-55b4d954d5-p78mx\" (UID: \"e2ca5645-f7db-4af6-bc13-0fd406369a63\") " pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:11.815711 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:11.815669 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p78mx" Sep 17 02:52:12.083192 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:12.083167 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p78mx"] Sep 17 02:52:12.084708 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:52:12.084676 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ca5645_f7db_4af6_bc13_0fd406369a63.slice/crio-8b5048f05f48e30177222160b53693e71d829899849749abb492045db9bf5be0 WatchSource:0}: Error finding container 8b5048f05f48e30177222160b53693e71d829899849749abb492045db9bf5be0: Status 404 returned error can't find the container with id 8b5048f05f48e30177222160b53693e71d829899849749abb492045db9bf5be0 Sep 17 02:52:12.148328 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:12.148289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p78mx" event={"ID":"e2ca5645-f7db-4af6-bc13-0fd406369a63","Type":"ContainerStarted","Data":"8b5048f05f48e30177222160b53693e71d829899849749abb492045db9bf5be0"} Sep 17 02:52:15.162591 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:15.162548 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p78mx" event={"ID":"e2ca5645-f7db-4af6-bc13-0fd406369a63","Type":"ContainerStarted","Data":"988cb30aff92efe43bebc0621820a9ffedbe3b49c77909540942e068673c6db6"} Sep 17 02:52:15.181044 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:15.180995 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-p78mx" podStartSLOduration=1.18764525 podStartE2EDuration="4.18096925s" totalImagesPullingTime="2.993324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:52:15.180270653 +0000 UTC m=+506.315386998" watchObservedRunningTime="2026-09-17 02:52:15.18096925 +0000 UTC m=+506.316085594" Sep 17 02:52:29.342114 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.342080 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q"] Sep 17 02:52:29.345286 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.345271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.348033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.348006 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 17 02:52:29.348033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.348009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-mpbd6\"" Sep 17 02:52:29.348177 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.348038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 17 02:52:29.353444 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.353426 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q"] Sep 17 02:52:29.400506 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.400479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a-tmp\") pod \"jobset-operator-5bc45f897-lgz4q\" (UID: \"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.400635 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.400564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6gd2\" (UniqueName: \"kubernetes.io/projected/2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a-kube-api-access-f6gd2\") pod \"jobset-operator-5bc45f897-lgz4q\" (UID: \"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.502012 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.501976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6gd2\" (UniqueName: \"kubernetes.io/projected/2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a-kube-api-access-f6gd2\") pod \"jobset-operator-5bc45f897-lgz4q\" (UID: \"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.502176 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.502031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a-tmp\") pod \"jobset-operator-5bc45f897-lgz4q\" (UID: \"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.502345 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.502325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a-tmp\") pod \"jobset-operator-5bc45f897-lgz4q\" (UID: \"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.509955 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.509933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6gd2\" (UniqueName: \"kubernetes.io/projected/2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a-kube-api-access-f6gd2\") pod \"jobset-operator-5bc45f897-lgz4q\" (UID: \"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.654369 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.654292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" Sep 17 02:52:29.922961 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:29.922937 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q"] Sep 17 02:52:29.925273 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:52:29.925234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c1f21d1_9b7f_4b9a_90f1_5668f7a90c4a.slice/crio-0a3c24122cbcd590b9d900121230f604dca1c5132980f09daf5217ffc4b5f798 WatchSource:0}: Error finding container 0a3c24122cbcd590b9d900121230f604dca1c5132980f09daf5217ffc4b5f798: Status 404 returned error can't find the container with id 0a3c24122cbcd590b9d900121230f604dca1c5132980f09daf5217ffc4b5f798 Sep 17 02:52:30.223248 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:30.223215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" event={"ID":"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a","Type":"ContainerStarted","Data":"0a3c24122cbcd590b9d900121230f604dca1c5132980f09daf5217ffc4b5f798"} Sep 17 02:52:33.241817 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:33.241767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" event={"ID":"2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a","Type":"ContainerStarted","Data":"43e996dc9f587217ac730e0b00f6c2cf2565d0d3b17482454e9ec09f9f474e2e"} Sep 17 02:52:33.258352 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:33.258306 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lgz4q" podStartSLOduration=1.805023155 podStartE2EDuration="4.258292522s" totalImagesPullingTime="2.453269367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:52:33.257604626 +0000 UTC m=+524.392720971" watchObservedRunningTime="2026-09-17 02:52:33.258292522 +0000 UTC m=+524.393408865" Sep 17 02:52:59.106131 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.106058 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7"] Sep 17 02:52:59.109985 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.109968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.112433 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.112399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 17 02:52:59.112561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.112447 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 02:52:59.112561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.112499 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 02:52:59.113972 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.113950 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-rk2zk\"" Sep 17 02:52:59.114087 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.114013 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 17 02:52:59.119010 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.118990 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7"] Sep 17 02:52:59.161302 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.161276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/15057eb1-19b3-44e4-b34c-666840d4a1fa-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.161404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.161307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15057eb1-19b3-44e4-b34c-666840d4a1fa-cert\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.161404 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.161348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2wtb\" (UniqueName: \"kubernetes.io/projected/15057eb1-19b3-44e4-b34c-666840d4a1fa-kube-api-access-q2wtb\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.262416 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.262378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/15057eb1-19b3-44e4-b34c-666840d4a1fa-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.262416 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.262423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15057eb1-19b3-44e4-b34c-666840d4a1fa-cert\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.262562 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.262454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2wtb\" (UniqueName: \"kubernetes.io/projected/15057eb1-19b3-44e4-b34c-666840d4a1fa-kube-api-access-q2wtb\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.263116 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.263096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/15057eb1-19b3-44e4-b34c-666840d4a1fa-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.264721 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.264702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15057eb1-19b3-44e4-b34c-666840d4a1fa-cert\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.270358 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.270337 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2wtb\" (UniqueName: \"kubernetes.io/projected/15057eb1-19b3-44e4-b34c-666840d4a1fa-kube-api-access-q2wtb\") pod \"kubeflow-trainer-controller-manager-f5c785cd-ghvk7\" (UID: \"15057eb1-19b3-44e4-b34c-666840d4a1fa\") " pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.420045 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.419959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:52:59.685865 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:52:59.685841 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7"] Sep 17 02:52:59.687974 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:52:59.687940 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15057eb1_19b3_44e4_b34c_666840d4a1fa.slice/crio-e772ce1a95b12eba54d2610326a4588e647f2ef1b586af9e2b982b03ec13e2d9 WatchSource:0}: Error finding container e772ce1a95b12eba54d2610326a4588e647f2ef1b586af9e2b982b03ec13e2d9: Status 404 returned error can't find the container with id e772ce1a95b12eba54d2610326a4588e647f2ef1b586af9e2b982b03ec13e2d9 Sep 17 02:53:00.350859 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:00.350818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" event={"ID":"15057eb1-19b3-44e4-b34c-666840d4a1fa","Type":"ContainerStarted","Data":"e772ce1a95b12eba54d2610326a4588e647f2ef1b586af9e2b982b03ec13e2d9"} Sep 17 02:53:02.360460 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:02.360424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" event={"ID":"15057eb1-19b3-44e4-b34c-666840d4a1fa","Type":"ContainerStarted","Data":"959cb887c77a4b12282aa3a1e00b77b4e46b689b83197f60e2ac8a06afb86f92"} Sep 17 02:53:02.360874 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:02.360551 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:53:02.376921 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:02.376877 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" podStartSLOduration=1.207820638 podStartE2EDuration="3.376863832s" totalImagesPullingTime="2.169043194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:53:02.374897281 +0000 UTC m=+553.510013626" watchObservedRunningTime="2026-09-17 02:53:02.376863832 +0000 UTC m=+553.511980176" Sep 17 02:53:18.369946 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:18.369915 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-f5c785cd-ghvk7" Sep 17 02:53:49.276990 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:49.276962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:53:49.277555 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:53:49.277542 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:54:44.870178 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.870134 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt"] Sep 17 02:54:44.873406 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.873389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:54:44.876007 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.875988 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"default-dockercfg-mdh57\"" Sep 17 02:54:44.876250 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.876235 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"openshift-service-ca.crt\"" Sep 17 02:54:44.876309 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.876293 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"kube-root-ca.crt\"" Sep 17 02:54:44.882733 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.882708 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt"] Sep 17 02:54:44.927108 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:44.927076 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlp7j\" (UniqueName: \"kubernetes.io/projected/e02568bb-ab51-46cc-80ed-56ae0b18db98-kube-api-access-qlp7j\") pod \"progression-enabled-node-0-0-99jbt\" (UID: \"e02568bb-ab51-46cc-80ed-56ae0b18db98\") " pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:54:45.027593 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:45.027555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlp7j\" (UniqueName: \"kubernetes.io/projected/e02568bb-ab51-46cc-80ed-56ae0b18db98-kube-api-access-qlp7j\") pod \"progression-enabled-node-0-0-99jbt\" (UID: \"e02568bb-ab51-46cc-80ed-56ae0b18db98\") " pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:54:45.036082 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:45.036051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlp7j\" (UniqueName: \"kubernetes.io/projected/e02568bb-ab51-46cc-80ed-56ae0b18db98-kube-api-access-qlp7j\") pod \"progression-enabled-node-0-0-99jbt\" (UID: \"e02568bb-ab51-46cc-80ed-56ae0b18db98\") " pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:54:45.184743 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:45.184657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:54:45.454306 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:45.454253 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt"] Sep 17 02:54:45.456594 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:54:45.456563 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02568bb_ab51_46cc_80ed_56ae0b18db98.slice/crio-b2317e2a09391bb3eec5764e804377eb8a9a26c1ddaa9b7eaa42a37ba19c6554 WatchSource:0}: Error finding container b2317e2a09391bb3eec5764e804377eb8a9a26c1ddaa9b7eaa42a37ba19c6554: Status 404 returned error can't find the container with id b2317e2a09391bb3eec5764e804377eb8a9a26c1ddaa9b7eaa42a37ba19c6554 Sep 17 02:54:45.458975 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:45.458957 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 02:54:45.799060 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:54:45.798981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" event={"ID":"e02568bb-ab51-46cc-80ed-56ae0b18db98","Type":"ContainerStarted","Data":"b2317e2a09391bb3eec5764e804377eb8a9a26c1ddaa9b7eaa42a37ba19c6554"} Sep 17 02:56:31.335660 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:31.335623 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" event={"ID":"e02568bb-ab51-46cc-80ed-56ae0b18db98","Type":"ContainerStarted","Data":"4c3aa1947e80b1d3d7fb1a07fce22c589645569e70280018dbff9198501e32ae"} Sep 17 02:56:31.336156 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:31.335688 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:56:31.352407 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:31.352356 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" podStartSLOduration=2.570504571 podStartE2EDuration="1m47.352341144s" totalImagesPullingTime="1m44.781836573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:56:31.350194565 +0000 UTC m=+762.485310909" watchObservedRunningTime="2026-09-17 02:56:31.352341144 +0000 UTC m=+762.487457488" Sep 17 02:56:32.338920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:32.338891 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:56:53.427393 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:53.427338 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": read tcp 10.132.0.2:59146->10.132.0.27:28080: read: connection reset by peer" Sep 17 02:56:54.336854 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:54.336818 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Sep 17 02:56:54.337014 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:54.336923 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:56:54.337328 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:54.337305 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Sep 17 02:56:54.435910 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:54.435876 2580 generic.go:356] "Generic (PLEG): container finished" podID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerID="4c3aa1947e80b1d3d7fb1a07fce22c589645569e70280018dbff9198501e32ae" exitCode=0 Sep 17 02:56:54.436301 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:54.435948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" event={"ID":"e02568bb-ab51-46cc-80ed-56ae0b18db98","Type":"ContainerDied","Data":"4c3aa1947e80b1d3d7fb1a07fce22c589645569e70280018dbff9198501e32ae"} Sep 17 02:56:55.586234 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:55.586203 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:56:55.595645 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:55.595618 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlp7j\" (UniqueName: \"kubernetes.io/projected/e02568bb-ab51-46cc-80ed-56ae0b18db98-kube-api-access-qlp7j\") pod \"e02568bb-ab51-46cc-80ed-56ae0b18db98\" (UID: \"e02568bb-ab51-46cc-80ed-56ae0b18db98\") " Sep 17 02:56:55.597708 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:55.597685 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02568bb-ab51-46cc-80ed-56ae0b18db98-kube-api-access-qlp7j" (OuterVolumeSpecName: "kube-api-access-qlp7j") pod "e02568bb-ab51-46cc-80ed-56ae0b18db98" (UID: "e02568bb-ab51-46cc-80ed-56ae0b18db98"). InnerVolumeSpecName "kube-api-access-qlp7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:56:55.696401 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:55.696318 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlp7j\" (UniqueName: \"kubernetes.io/projected/e02568bb-ab51-46cc-80ed-56ae0b18db98-kube-api-access-qlp7j\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:56:56.445511 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:56.445478 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" Sep 17 02:56:56.445698 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:56.445522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt" event={"ID":"e02568bb-ab51-46cc-80ed-56ae0b18db98","Type":"ContainerDied","Data":"b2317e2a09391bb3eec5764e804377eb8a9a26c1ddaa9b7eaa42a37ba19c6554"} Sep 17 02:56:56.445698 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:56.445578 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2317e2a09391bb3eec5764e804377eb8a9a26c1ddaa9b7eaa42a37ba19c6554" Sep 17 02:56:57.311630 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.311591 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs"] Sep 17 02:56:57.312063 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.311937 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerName="node" Sep 17 02:56:57.312063 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.311950 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerName="node" Sep 17 02:56:57.312063 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.312018 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" containerName="node" Sep 17 02:56:57.330912 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.330881 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs"] Sep 17 02:56:57.331087 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.331066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:56:57.333623 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.333599 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"kube-root-ca.crt\"" Sep 17 02:56:57.333749 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.333599 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"default-dockercfg-mdh57\"" Sep 17 02:56:57.333749 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.333645 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"openshift-service-ca.crt\"" Sep 17 02:56:57.408998 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.408960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvlkm\" (UniqueName: \"kubernetes.io/projected/e03e5204-bcfd-4c33-b5d5-bee9435f0c14-kube-api-access-gvlkm\") pod \"progression-disabled-node-0-0-z4vjs\" (UID: \"e03e5204-bcfd-4c33-b5d5-bee9435f0c14\") " pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:56:57.509512 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.509474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvlkm\" (UniqueName: \"kubernetes.io/projected/e03e5204-bcfd-4c33-b5d5-bee9435f0c14-kube-api-access-gvlkm\") pod \"progression-disabled-node-0-0-z4vjs\" (UID: \"e03e5204-bcfd-4c33-b5d5-bee9435f0c14\") " pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:56:57.517700 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.517672 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvlkm\" (UniqueName: \"kubernetes.io/projected/e03e5204-bcfd-4c33-b5d5-bee9435f0c14-kube-api-access-gvlkm\") pod \"progression-disabled-node-0-0-z4vjs\" (UID: \"e03e5204-bcfd-4c33-b5d5-bee9435f0c14\") " pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:56:57.640695 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.640614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:56:57.920647 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:57.920619 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs"] Sep 17 02:56:57.922695 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:56:57.922665 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03e5204_bcfd_4c33_b5d5_bee9435f0c14.slice/crio-f192baea78fd15071bb0af41fe977f9a13e9fe32e2c73410c9a38e699856427f WatchSource:0}: Error finding container f192baea78fd15071bb0af41fe977f9a13e9fe32e2c73410c9a38e699856427f: Status 404 returned error can't find the container with id f192baea78fd15071bb0af41fe977f9a13e9fe32e2c73410c9a38e699856427f Sep 17 02:56:58.455945 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:58.455910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" event={"ID":"e03e5204-bcfd-4c33-b5d5-bee9435f0c14","Type":"ContainerStarted","Data":"ad56a870ecb86bd01b37e26239f5dd1630a529853cbdec1aea0350e2b96a115b"} Sep 17 02:56:58.456350 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:58.455958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" event={"ID":"e03e5204-bcfd-4c33-b5d5-bee9435f0c14","Type":"ContainerStarted","Data":"f192baea78fd15071bb0af41fe977f9a13e9fe32e2c73410c9a38e699856427f"} Sep 17 02:56:58.456350 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:58.456058 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:56:58.473389 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:56:58.473343 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" podStartSLOduration=1.473329132 podStartE2EDuration="1.473329132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:56:58.471838584 +0000 UTC m=+789.606954927" watchObservedRunningTime="2026-09-17 02:56:58.473329132 +0000 UTC m=+789.608445475" Sep 17 02:57:00.463359 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:00.463328 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:57:21.460807 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:21.460741 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" podUID="e03e5204-bcfd-4c33-b5d5-bee9435f0c14" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Sep 17 02:57:21.559012 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:21.558978 2580 generic.go:356] "Generic (PLEG): container finished" podID="e03e5204-bcfd-4c33-b5d5-bee9435f0c14" containerID="ad56a870ecb86bd01b37e26239f5dd1630a529853cbdec1aea0350e2b96a115b" exitCode=0 Sep 17 02:57:21.559204 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:21.559053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" event={"ID":"e03e5204-bcfd-4c33-b5d5-bee9435f0c14","Type":"ContainerDied","Data":"ad56a870ecb86bd01b37e26239f5dd1630a529853cbdec1aea0350e2b96a115b"} Sep 17 02:57:22.691513 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:22.691489 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:57:22.812644 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:22.812611 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvlkm\" (UniqueName: \"kubernetes.io/projected/e03e5204-bcfd-4c33-b5d5-bee9435f0c14-kube-api-access-gvlkm\") pod \"e03e5204-bcfd-4c33-b5d5-bee9435f0c14\" (UID: \"e03e5204-bcfd-4c33-b5d5-bee9435f0c14\") " Sep 17 02:57:22.814712 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:22.814646 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e03e5204-bcfd-4c33-b5d5-bee9435f0c14-kube-api-access-gvlkm" (OuterVolumeSpecName: "kube-api-access-gvlkm") pod "e03e5204-bcfd-4c33-b5d5-bee9435f0c14" (UID: "e03e5204-bcfd-4c33-b5d5-bee9435f0c14"). InnerVolumeSpecName "kube-api-access-gvlkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:57:22.913715 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:22.913690 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvlkm\" (UniqueName: \"kubernetes.io/projected/e03e5204-bcfd-4c33-b5d5-bee9435f0c14-kube-api-access-gvlkm\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:57:23.568733 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:23.568696 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" Sep 17 02:57:23.568733 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:23.568725 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs" event={"ID":"e03e5204-bcfd-4c33-b5d5-bee9435f0c14","Type":"ContainerDied","Data":"f192baea78fd15071bb0af41fe977f9a13e9fe32e2c73410c9a38e699856427f"} Sep 17 02:57:23.568985 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:23.568774 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f192baea78fd15071bb0af41fe977f9a13e9fe32e2c73410c9a38e699856427f" Sep 17 02:57:32.303580 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.303545 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv"] Sep 17 02:57:32.304033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.303919 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03e5204-bcfd-4c33-b5d5-bee9435f0c14" containerName="node" Sep 17 02:57:32.304033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.303931 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03e5204-bcfd-4c33-b5d5-bee9435f0c14" containerName="node" Sep 17 02:57:32.304033 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.303982 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e03e5204-bcfd-4c33-b5d5-bee9435f0c14" containerName="node" Sep 17 02:57:32.305926 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.305904 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:32.308564 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.308541 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"openshift-service-ca.crt\"" Sep 17 02:57:32.308682 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.308626 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"default-dockercfg-mdh57\"" Sep 17 02:57:32.308749 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.308730 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"kube-root-ca.crt\"" Sep 17 02:57:32.316191 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.316169 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv"] Sep 17 02:57:32.393262 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.393220 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxpx\" (UniqueName: \"kubernetes.io/projected/02f65051-8e64-4725-8c40-8d48e0d4f7ed-kube-api-access-wsxpx\") pod \"progression-invalid-node-0-0-s7zwv\" (UID: \"02f65051-8e64-4725-8c40-8d48e0d4f7ed\") " pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:32.494678 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.494625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxpx\" (UniqueName: \"kubernetes.io/projected/02f65051-8e64-4725-8c40-8d48e0d4f7ed-kube-api-access-wsxpx\") pod \"progression-invalid-node-0-0-s7zwv\" (UID: \"02f65051-8e64-4725-8c40-8d48e0d4f7ed\") " pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:32.502920 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.502885 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxpx\" (UniqueName: \"kubernetes.io/projected/02f65051-8e64-4725-8c40-8d48e0d4f7ed-kube-api-access-wsxpx\") pod \"progression-invalid-node-0-0-s7zwv\" (UID: \"02f65051-8e64-4725-8c40-8d48e0d4f7ed\") " pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:32.615828 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.615727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:32.888679 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:32.888648 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv"] Sep 17 02:57:32.892027 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:57:32.891992 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f65051_8e64_4725_8c40_8d48e0d4f7ed.slice/crio-5658c82580798ba020412dc45020e2f0843b8e4f41b23c0938af3aca68bad71b WatchSource:0}: Error finding container 5658c82580798ba020412dc45020e2f0843b8e4f41b23c0938af3aca68bad71b: Status 404 returned error can't find the container with id 5658c82580798ba020412dc45020e2f0843b8e4f41b23c0938af3aca68bad71b Sep 17 02:57:33.619063 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:33.619020 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" event={"ID":"02f65051-8e64-4725-8c40-8d48e0d4f7ed","Type":"ContainerStarted","Data":"d47b745c23bde0b16abe485dc0961685c646cb036a8b6fd63c58941f7e0a962f"} Sep 17 02:57:33.619546 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:33.619091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" event={"ID":"02f65051-8e64-4725-8c40-8d48e0d4f7ed","Type":"ContainerStarted","Data":"5658c82580798ba020412dc45020e2f0843b8e4f41b23c0938af3aca68bad71b"} Sep 17 02:57:33.619868 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:33.619845 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:33.638397 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:33.638343 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" podStartSLOduration=1.638324892 podStartE2EDuration="1.638324892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:57:33.636915436 +0000 UTC m=+824.772031781" watchObservedRunningTime="2026-09-17 02:57:33.638324892 +0000 UTC m=+824.773441239" Sep 17 02:57:34.622410 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:34.622380 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:56.621171 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:56.621122 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" podUID="02f65051-8e64-4725-8c40-8d48e0d4f7ed" containerName="node" probeResult="failure" output="Get \"http://10.132.0.29:28080/metrics\": dial tcp 10.132.0.29:28080: connect: connection refused" Sep 17 02:57:56.723994 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:56.723962 2580 generic.go:356] "Generic (PLEG): container finished" podID="02f65051-8e64-4725-8c40-8d48e0d4f7ed" containerID="d47b745c23bde0b16abe485dc0961685c646cb036a8b6fd63c58941f7e0a962f" exitCode=0 Sep 17 02:57:56.723994 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:56.724000 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" event={"ID":"02f65051-8e64-4725-8c40-8d48e0d4f7ed","Type":"ContainerDied","Data":"d47b745c23bde0b16abe485dc0961685c646cb036a8b6fd63c58941f7e0a962f"} Sep 17 02:57:57.861075 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:57.861047 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:57.913561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:57.913524 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsxpx\" (UniqueName: \"kubernetes.io/projected/02f65051-8e64-4725-8c40-8d48e0d4f7ed-kube-api-access-wsxpx\") pod \"02f65051-8e64-4725-8c40-8d48e0d4f7ed\" (UID: \"02f65051-8e64-4725-8c40-8d48e0d4f7ed\") " Sep 17 02:57:57.921491 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:57.921316 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f65051-8e64-4725-8c40-8d48e0d4f7ed-kube-api-access-wsxpx" (OuterVolumeSpecName: "kube-api-access-wsxpx") pod "02f65051-8e64-4725-8c40-8d48e0d4f7ed" (UID: "02f65051-8e64-4725-8c40-8d48e0d4f7ed"). InnerVolumeSpecName "kube-api-access-wsxpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:57:58.014368 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:58.014294 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsxpx\" (UniqueName: \"kubernetes.io/projected/02f65051-8e64-4725-8c40-8d48e0d4f7ed-kube-api-access-wsxpx\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:57:58.734561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:58.734525 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" event={"ID":"02f65051-8e64-4725-8c40-8d48e0d4f7ed","Type":"ContainerDied","Data":"5658c82580798ba020412dc45020e2f0843b8e4f41b23c0938af3aca68bad71b"} Sep 17 02:57:58.734561 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:58.734551 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv" Sep 17 02:57:58.734765 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:57:58.734572 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5658c82580798ba020412dc45020e2f0843b8e4f41b23c0938af3aca68bad71b" Sep 17 02:58:49.306434 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:58:49.306358 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:58:49.308326 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:58:49.308300 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 02:59:47.949925 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.949890 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb"] Sep 17 02:59:47.951088 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.950246 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f65051-8e64-4725-8c40-8d48e0d4f7ed" containerName="node" Sep 17 02:59:47.951088 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.950258 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f65051-8e64-4725-8c40-8d48e0d4f7ed" containerName="node" Sep 17 02:59:47.951088 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.950322 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02f65051-8e64-4725-8c40-8d48e0d4f7ed" containerName="node" Sep 17 02:59:47.951882 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.951863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:47.954484 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.954442 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"kube-root-ca.crt\"" Sep 17 02:59:47.954484 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.954445 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"openshift-service-ca.crt\"" Sep 17 02:59:47.955685 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.955665 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-nsrs6\"/\"default-dockercfg-mdh57\"" Sep 17 02:59:47.961649 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.961628 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb"] Sep 17 02:59:47.999154 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:47.999127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr6c4\" (UniqueName: \"kubernetes.io/projected/45ed31dc-4028-43c5-9bc3-dfe2904b1481-kube-api-access-kr6c4\") pod \"progression-no-metrics-node-0-0-ftkjb\" (UID: \"45ed31dc-4028-43c5-9bc3-dfe2904b1481\") " pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:48.100477 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:48.100437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6c4\" (UniqueName: \"kubernetes.io/projected/45ed31dc-4028-43c5-9bc3-dfe2904b1481-kube-api-access-kr6c4\") pod \"progression-no-metrics-node-0-0-ftkjb\" (UID: \"45ed31dc-4028-43c5-9bc3-dfe2904b1481\") " pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:48.107969 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:48.107938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr6c4\" (UniqueName: \"kubernetes.io/projected/45ed31dc-4028-43c5-9bc3-dfe2904b1481-kube-api-access-kr6c4\") pod \"progression-no-metrics-node-0-0-ftkjb\" (UID: \"45ed31dc-4028-43c5-9bc3-dfe2904b1481\") " pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:48.262576 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:48.262480 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:48.529353 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:48.529327 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb"] Sep 17 02:59:48.531954 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:59:48.531924 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ed31dc_4028_43c5_9bc3_dfe2904b1481.slice/crio-a18dcfb724c0db24031e2dd219c48ddd36d43bb361eb7acd7378132d563ad880 WatchSource:0}: Error finding container a18dcfb724c0db24031e2dd219c48ddd36d43bb361eb7acd7378132d563ad880: Status 404 returned error can't find the container with id a18dcfb724c0db24031e2dd219c48ddd36d43bb361eb7acd7378132d563ad880 Sep 17 02:59:49.243604 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:49.243567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" event={"ID":"45ed31dc-4028-43c5-9bc3-dfe2904b1481","Type":"ContainerStarted","Data":"d4945226d222a5b038b36efe5633e41de08ec7dbf41284f2c093558c1f6bff0f"} Sep 17 02:59:49.244024 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:49.243626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" event={"ID":"45ed31dc-4028-43c5-9bc3-dfe2904b1481","Type":"ContainerStarted","Data":"a18dcfb724c0db24031e2dd219c48ddd36d43bb361eb7acd7378132d563ad880"} Sep 17 02:59:49.260950 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:49.260904 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" podStartSLOduration=2.2608907 podStartE2EDuration="2.2608907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:59:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:59:49.258619705 +0000 UTC m=+960.393736049" watchObservedRunningTime="2026-09-17 02:59:49.2608907 +0000 UTC m=+960.396007044" Sep 17 02:59:54.268228 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:54.268192 2580 generic.go:356] "Generic (PLEG): container finished" podID="45ed31dc-4028-43c5-9bc3-dfe2904b1481" containerID="d4945226d222a5b038b36efe5633e41de08ec7dbf41284f2c093558c1f6bff0f" exitCode=0 Sep 17 02:59:54.268631 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:54.268258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" event={"ID":"45ed31dc-4028-43c5-9bc3-dfe2904b1481","Type":"ContainerDied","Data":"d4945226d222a5b038b36efe5633e41de08ec7dbf41284f2c093558c1f6bff0f"} Sep 17 02:59:55.404352 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:55.404322 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:55.465447 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:55.465412 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr6c4\" (UniqueName: \"kubernetes.io/projected/45ed31dc-4028-43c5-9bc3-dfe2904b1481-kube-api-access-kr6c4\") pod \"45ed31dc-4028-43c5-9bc3-dfe2904b1481\" (UID: \"45ed31dc-4028-43c5-9bc3-dfe2904b1481\") " Sep 17 02:59:55.467605 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:55.467574 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ed31dc-4028-43c5-9bc3-dfe2904b1481-kube-api-access-kr6c4" (OuterVolumeSpecName: "kube-api-access-kr6c4") pod "45ed31dc-4028-43c5-9bc3-dfe2904b1481" (UID: "45ed31dc-4028-43c5-9bc3-dfe2904b1481"). InnerVolumeSpecName "kube-api-access-kr6c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 02:59:55.566884 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:55.566777 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr6c4\" (UniqueName: \"kubernetes.io/projected/45ed31dc-4028-43c5-9bc3-dfe2904b1481-kube-api-access-kr6c4\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 02:59:56.279249 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:56.279212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" event={"ID":"45ed31dc-4028-43c5-9bc3-dfe2904b1481","Type":"ContainerDied","Data":"a18dcfb724c0db24031e2dd219c48ddd36d43bb361eb7acd7378132d563ad880"} Sep 17 02:59:56.279419 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:56.279264 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a18dcfb724c0db24031e2dd219c48ddd36d43bb361eb7acd7378132d563ad880" Sep 17 02:59:56.279419 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:56.279219 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb" Sep 17 02:59:58.339854 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.339766 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gmvnv/must-gather-fldbd"] Sep 17 02:59:58.340279 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.340239 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ed31dc-4028-43c5-9bc3-dfe2904b1481" containerName="node" Sep 17 02:59:58.340279 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.340255 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ed31dc-4028-43c5-9bc3-dfe2904b1481" containerName="node" Sep 17 02:59:58.340427 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.340339 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ed31dc-4028-43c5-9bc3-dfe2904b1481" containerName="node" Sep 17 02:59:58.342210 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.342193 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.344922 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.344900 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gmvnv\"/\"kube-root-ca.crt\"" Sep 17 02:59:58.345028 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.344903 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gmvnv\"/\"default-dockercfg-v9dxm\"" Sep 17 02:59:58.345958 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.345939 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gmvnv\"/\"openshift-service-ca.crt\"" Sep 17 02:59:58.350608 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.350585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gmvnv/must-gather-fldbd"] Sep 17 02:59:58.389700 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.389674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75m8g\" (UniqueName: \"kubernetes.io/projected/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-kube-api-access-75m8g\") pod \"must-gather-fldbd\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.389843 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.389726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-must-gather-output\") pod \"must-gather-fldbd\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.490866 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.490841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-must-gather-output\") pod \"must-gather-fldbd\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.491024 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.490899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75m8g\" (UniqueName: \"kubernetes.io/projected/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-kube-api-access-75m8g\") pod \"must-gather-fldbd\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.491223 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.491201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-must-gather-output\") pod \"must-gather-fldbd\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.498326 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.498305 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75m8g\" (UniqueName: \"kubernetes.io/projected/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-kube-api-access-75m8g\") pod \"must-gather-fldbd\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.651530 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.651467 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 02:59:58.920526 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.920497 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gmvnv/must-gather-fldbd"] Sep 17 02:59:58.922231 ip-10-0-135-174 kubenswrapper[2580]: W0917 02:59:58.922197 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5d6ee80_e5bb_4740_be57_70cc1a40cb81.slice/crio-b1c3a58148cebbd5e71bf4d09d11efb958f01317cd476f503c915131fd074ef3 WatchSource:0}: Error finding container b1c3a58148cebbd5e71bf4d09d11efb958f01317cd476f503c915131fd074ef3: Status 404 returned error can't find the container with id b1c3a58148cebbd5e71bf4d09d11efb958f01317cd476f503c915131fd074ef3 Sep 17 02:59:58.923981 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:58.923964 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 02:59:59.294421 ip-10-0-135-174 kubenswrapper[2580]: I0917 02:59:59.294388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmvnv/must-gather-fldbd" event={"ID":"c5d6ee80-e5bb-4740-be57-70cc1a40cb81","Type":"ContainerStarted","Data":"b1c3a58148cebbd5e71bf4d09d11efb958f01317cd476f503c915131fd074ef3"} Sep 17 03:00:02.914454 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.914414 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs"] Sep 17 03:00:02.919604 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.919574 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-disabled-node-0-0-z4vjs"] Sep 17 03:00:02.924680 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.924651 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt"] Sep 17 03:00:02.930052 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.929910 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-enabled-node-0-0-99jbt"] Sep 17 03:00:02.933568 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.933545 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv"] Sep 17 03:00:02.935770 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.935746 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-invalid-node-0-0-s7zwv"] Sep 17 03:00:02.948855 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.948823 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb"] Sep 17 03:00:02.950368 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:02.950339 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-nsrs6/progression-no-metrics-node-0-0-ftkjb"] Sep 17 03:00:03.327064 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:03.327029 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02f65051-8e64-4725-8c40-8d48e0d4f7ed" path="/var/lib/kubelet/pods/02f65051-8e64-4725-8c40-8d48e0d4f7ed/volumes" Sep 17 03:00:03.327401 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:03.327385 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ed31dc-4028-43c5-9bc3-dfe2904b1481" path="/var/lib/kubelet/pods/45ed31dc-4028-43c5-9bc3-dfe2904b1481/volumes" Sep 17 03:00:03.327693 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:03.327681 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e02568bb-ab51-46cc-80ed-56ae0b18db98" path="/var/lib/kubelet/pods/e02568bb-ab51-46cc-80ed-56ae0b18db98/volumes" Sep 17 03:00:03.327994 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:03.327980 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e03e5204-bcfd-4c33-b5d5-bee9435f0c14" path="/var/lib/kubelet/pods/e03e5204-bcfd-4c33-b5d5-bee9435f0c14/volumes" Sep 17 03:00:05.332559 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:05.332474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmvnv/must-gather-fldbd" event={"ID":"c5d6ee80-e5bb-4740-be57-70cc1a40cb81","Type":"ContainerStarted","Data":"656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da"} Sep 17 03:00:05.332559 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:05.332515 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmvnv/must-gather-fldbd" event={"ID":"c5d6ee80-e5bb-4740-be57-70cc1a40cb81","Type":"ContainerStarted","Data":"4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c"} Sep 17 03:00:05.348182 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:05.348140 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gmvnv/must-gather-fldbd" podStartSLOduration=1.325980401 podStartE2EDuration="7.348123456s" totalImagesPullingTime="6.022143055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:00:05.346284593 +0000 UTC m=+976.481400938" watchObservedRunningTime="2026-09-17 03:00:05.348123456 +0000 UTC m=+976.483239799" Sep 17 03:00:48.579213 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:48.579179 2580 generic.go:356] "Generic (PLEG): container finished" podID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerID="4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c" exitCode=0 Sep 17 03:00:48.579683 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:48.579253 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmvnv/must-gather-fldbd" event={"ID":"c5d6ee80-e5bb-4740-be57-70cc1a40cb81","Type":"ContainerDied","Data":"4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c"} Sep 17 03:00:48.579818 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:48.579709 2580 scope.go:117] "RemoveContainer" containerID="4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c" Sep 17 03:00:49.537873 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:49.537841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gmvnv_must-gather-fldbd_c5d6ee80-e5bb-4740-be57-70cc1a40cb81/gather/0.log" Sep 17 03:00:53.089687 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:53.089653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l5tbz_e151274c-f201-4606-8c17-0dc492507886/global-pull-secret-syncer/0.log" Sep 17 03:00:53.280932 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:53.280903 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hg2q9_33aaf49e-3802-4d05-b321-2b5c5c92e324/konnectivity-agent/0.log" Sep 17 03:00:53.328421 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:53.328389 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-174.ec2.internal_ef1bc5b13e9d8074b0d9ee981b83a940/haproxy/0.log" Sep 17 03:00:54.855671 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:54.855635 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-gmvnv/must-gather-fldbd"] Sep 17 03:00:54.856240 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:54.855846 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-gmvnv/must-gather-fldbd" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="copy" containerID="cri-o://656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da" gracePeriod=2 Sep 17 03:00:54.858397 ip-10-0-135-174 kubenswrapper[2580]: E0917 03:00:54.858357 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fldbd\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gmvnv\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 03:00:54.859944 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:54.859923 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-gmvnv/must-gather-fldbd"] Sep 17 03:00:55.093588 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.093563 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gmvnv_must-gather-fldbd_c5d6ee80-e5bb-4740-be57-70cc1a40cb81/copy/0.log" Sep 17 03:00:55.096222 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.096202 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 03:00:55.098450 ip-10-0-135-174 kubenswrapper[2580]: E0917 03:00:55.098425 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fldbd\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gmvnv\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 03:00:55.188190 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.188152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-must-gather-output\") pod \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " Sep 17 03:00:55.188338 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.188206 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75m8g\" (UniqueName: \"kubernetes.io/projected/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-kube-api-access-75m8g\") pod \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\" (UID: \"c5d6ee80-e5bb-4740-be57-70cc1a40cb81\") " Sep 17 03:00:55.189463 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.189438 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "c5d6ee80-e5bb-4740-be57-70cc1a40cb81" (UID: "c5d6ee80-e5bb-4740-be57-70cc1a40cb81"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:00:55.190373 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.190347 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-kube-api-access-75m8g" (OuterVolumeSpecName: "kube-api-access-75m8g") pod "c5d6ee80-e5bb-4740-be57-70cc1a40cb81" (UID: "c5d6ee80-e5bb-4740-be57-70cc1a40cb81"). InnerVolumeSpecName "kube-api-access-75m8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:00:55.289571 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.289532 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-must-gather-output\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 03:00:55.289571 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.289563 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75m8g\" (UniqueName: \"kubernetes.io/projected/c5d6ee80-e5bb-4740-be57-70cc1a40cb81-kube-api-access-75m8g\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\"" Sep 17 03:00:55.325740 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.325708 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" path="/var/lib/kubelet/pods/c5d6ee80-e5bb-4740-be57-70cc1a40cb81/volumes" Sep 17 03:00:55.620060 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.619981 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gmvnv_must-gather-fldbd_c5d6ee80-e5bb-4740-be57-70cc1a40cb81/copy/0.log" Sep 17 03:00:55.620347 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.620323 2580 generic.go:356] "Generic (PLEG): container finished" podID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerID="656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da" exitCode=143 Sep 17 03:00:55.620432 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.620377 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmvnv/must-gather-fldbd" Sep 17 03:00:55.620432 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.620425 2580 scope.go:117] "RemoveContainer" containerID="656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da" Sep 17 03:00:55.628225 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.628208 2580 scope.go:117] "RemoveContainer" containerID="4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c" Sep 17 03:00:55.640012 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.639988 2580 scope.go:117] "RemoveContainer" containerID="656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da" Sep 17 03:00:55.640267 ip-10-0-135-174 kubenswrapper[2580]: E0917 03:00:55.640246 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da\": container with ID starting with 656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da not found: ID does not exist" containerID="656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da" Sep 17 03:00:55.640336 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.640277 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da"} err="failed to get container status \"656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da\": rpc error: code = NotFound desc = could not find container \"656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da\": container with ID starting with 656201067b69bbf0f27d8a0bd379999685c3b2f8dec2f7ec76c283a68b65f1da not found: ID does not exist" Sep 17 03:00:55.640336 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.640300 2580 scope.go:117] "RemoveContainer" containerID="4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c" Sep 17 03:00:55.640553 ip-10-0-135-174 kubenswrapper[2580]: E0917 03:00:55.640536 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c\": container with ID starting with 4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c not found: ID does not exist" containerID="4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c" Sep 17 03:00:55.640606 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:55.640562 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c"} err="failed to get container status \"4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c\": rpc error: code = NotFound desc = could not find container \"4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c\": container with ID starting with 4f7f965dfbcfcb3cf4e2971c89910a1c43bfa7aa91e5655539405c540aa1956c not found: ID does not exist" Sep 17 03:00:57.069945 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.069901 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-rggzq_099be3c7-100c-4f64-b861-f0944c92af73/cluster-monitoring-operator/0.log" Sep 17 03:00:57.264284 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.264245 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zxwt_e30a2ea8-5137-4dbc-8644-ba8623a34146/node-exporter/0.log" Sep 17 03:00:57.282931 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.282907 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zxwt_e30a2ea8-5137-4dbc-8644-ba8623a34146/kube-rbac-proxy/0.log" Sep 17 03:00:57.303724 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.303704 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zxwt_e30a2ea8-5137-4dbc-8644-ba8623a34146/init-textfile/0.log" Sep 17 03:00:57.499981 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.499949 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-cnnw4_f4849299-08b5-4025-a67d-d8a83fe5cf22/kube-rbac-proxy-main/0.log" Sep 17 03:00:57.520774 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.520695 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-cnnw4_f4849299-08b5-4025-a67d-d8a83fe5cf22/kube-rbac-proxy-self/0.log" Sep 17 03:00:57.540664 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.540629 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-cnnw4_f4849299-08b5-4025-a67d-d8a83fe5cf22/openshift-state-metrics/0.log" Sep 17 03:00:57.580778 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.580746 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/prometheus/0.log" Sep 17 03:00:57.603621 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.603595 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/config-reloader/0.log" Sep 17 03:00:57.624797 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.624771 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/thanos-sidecar/0.log" Sep 17 03:00:57.651366 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.651336 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/kube-rbac-proxy-web/0.log" Sep 17 03:00:57.670906 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.670881 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/kube-rbac-proxy/0.log" Sep 17 03:00:57.694442 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.694418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/kube-rbac-proxy-thanos/0.log" Sep 17 03:00:57.712638 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.712619 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e527d10c-03c6-4db4-a6fa-9da5fa6cd86d/init-config-reloader/0.log" Sep 17 03:00:57.738023 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.737976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-ss745_6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82/prometheus-operator/0.log" Sep 17 03:00:57.756388 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.756367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-ss745_6ef5927c-4fbe-4f2b-aa7f-f3fcf2328d82/kube-rbac-proxy/0.log" Sep 17 03:00:57.778165 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.778103 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-l8tcj_221eeb39-cb5d-41cb-bd14-b03025632aee/prometheus-operator-admission-webhook/0.log" Sep 17 03:00:57.895123 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.895085 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f966bb7f-d6jhj_2d22171f-938f-4e81-a4fd-1daf43b70258/thanos-query/0.log" Sep 17 03:00:57.914207 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.914181 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f966bb7f-d6jhj_2d22171f-938f-4e81-a4fd-1daf43b70258/kube-rbac-proxy-web/0.log" Sep 17 03:00:57.937258 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.937217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f966bb7f-d6jhj_2d22171f-938f-4e81-a4fd-1daf43b70258/kube-rbac-proxy/0.log" Sep 17 03:00:57.961554 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.961527 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f966bb7f-d6jhj_2d22171f-938f-4e81-a4fd-1daf43b70258/prom-label-proxy/0.log" Sep 17 03:00:57.981229 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:57.981195 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f966bb7f-d6jhj_2d22171f-938f-4e81-a4fd-1daf43b70258/kube-rbac-proxy-rules/0.log" Sep 17 03:00:58.002885 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:58.002863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f966bb7f-d6jhj_2d22171f-938f-4e81-a4fd-1daf43b70258/kube-rbac-proxy-metrics/0.log" Sep 17 03:00:59.357244 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:00:59.357214 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-9wwbf_1e3aad2f-5f5c-443f-8ef6-3295344373ca/networking-console-plugin/0.log" Sep 17 03:01:01.209225 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209188 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p"] Sep 17 03:01:01.209580 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209550 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="copy" Sep 17 03:01:01.209580 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209562 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="copy" Sep 17 03:01:01.209580 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209580 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="gather" Sep 17 03:01:01.209681 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209586 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="gather" Sep 17 03:01:01.209681 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209640 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="gather" Sep 17 03:01:01.209681 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.209647 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d6ee80-e5bb-4740-be57-70cc1a40cb81" containerName="copy" Sep 17 03:01:01.214565 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.214545 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.217061 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.217037 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wqcf\"/\"openshift-service-ca.crt\"" Sep 17 03:01:01.217176 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.217061 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wqcf\"/\"kube-root-ca.crt\"" Sep 17 03:01:01.218303 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.218283 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9wqcf\"/\"default-dockercfg-k6p98\"" Sep 17 03:01:01.220395 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.220376 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p"] Sep 17 03:01:01.341050 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.341013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-proc\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.341229 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.341062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-lib-modules\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.341229 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.341139 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-podres\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.341229 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.341197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2sq\" (UniqueName: \"kubernetes.io/projected/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-kube-api-access-ns2sq\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.341378 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.341245 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-sys\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442548 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-podres\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442722 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2sq\" (UniqueName: \"kubernetes.io/projected/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-kube-api-access-ns2sq\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442722 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-sys\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442722 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-proc\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442722 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-lib-modules\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442722 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-podres\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442988 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442725 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-sys\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442988 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-lib-modules\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.442988 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.442746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-proc\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.450017 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.449996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2sq\" (UniqueName: \"kubernetes.io/projected/a7592f0a-2c3f-4c77-8d37-6e61fba067d9-kube-api-access-ns2sq\") pod \"perf-node-gather-daemonset-txv9p\" (UID: \"a7592f0a-2c3f-4c77-8d37-6e61fba067d9\") " pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.525587 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.525495 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:01.746751 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.746721 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pcsrp_5f3c5a47-09c3-401c-8aac-30d325331c99/dns/0.log" Sep 17 03:01:01.764715 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.764682 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pcsrp_5f3c5a47-09c3-401c-8aac-30d325331c99/kube-rbac-proxy/0.log" Sep 17 03:01:01.794085 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.794028 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p"] Sep 17 03:01:01.797051 ip-10-0-135-174 kubenswrapper[2580]: W0917 03:01:01.797026 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda7592f0a_2c3f_4c77_8d37_6e61fba067d9.slice/crio-f7957caa6652cd9bbc96ae8ebc6d83593887dd1cd563498c1658990dba630077 WatchSource:0}: Error finding container f7957caa6652cd9bbc96ae8ebc6d83593887dd1cd563498c1658990dba630077: Status 404 returned error can't find the container with id f7957caa6652cd9bbc96ae8ebc6d83593887dd1cd563498c1658990dba630077 Sep 17 03:01:01.832390 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:01.832367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qmq5n_273cbf5e-736f-4ef0-bde7-31f77e2a26be/dns-node-resolver/0.log" Sep 17 03:01:02.235332 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:02.235299 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gkklv_5c405b6c-9d6b-4377-89d7-4242a41c6102/node-ca/0.log" Sep 17 03:01:02.660090 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:02.660004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" event={"ID":"a7592f0a-2c3f-4c77-8d37-6e61fba067d9","Type":"ContainerStarted","Data":"baf673b4e92beffeb1f5529fd3b77a8d622f0af511c230f66b74aac2fd0a9083"} Sep 17 03:01:02.660090 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:02.660053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" event={"ID":"a7592f0a-2c3f-4c77-8d37-6e61fba067d9","Type":"ContainerStarted","Data":"f7957caa6652cd9bbc96ae8ebc6d83593887dd1cd563498c1658990dba630077"} Sep 17 03:01:02.660262 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:02.660096 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:02.680287 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:02.680238 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" podStartSLOduration=1.680222923 podStartE2EDuration="1.680222923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:01:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:01:02.679168149 +0000 UTC m=+1033.814284495" watchObservedRunningTime="2026-09-17 03:01:02.680222923 +0000 UTC m=+1033.815339312" Sep 17 03:01:03.327624 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:03.327597 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-npb4m_191ed4a8-cff5-43e6-9b83-a9fb15d4846d/serve-healthcheck-canary/0.log" Sep 17 03:01:03.686361 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:03.686275 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-hcfz6_b72e942f-db8e-48e2-8e44-b8d0af99166b/insights-operator/1.log" Sep 17 03:01:03.686956 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:03.686933 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-hcfz6_b72e942f-db8e-48e2-8e44-b8d0af99166b/insights-operator/0.log" Sep 17 03:01:03.704861 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:03.704839 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8nqrk_73f67352-1335-428c-9cc7-d461177f36b8/kube-rbac-proxy/0.log" Sep 17 03:01:03.722061 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:03.722037 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8nqrk_73f67352-1335-428c-9cc7-d461177f36b8/exporter/0.log" Sep 17 03:01:03.739995 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:03.739977 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8nqrk_73f67352-1335-428c-9cc7-d461177f36b8/extractor/0.log" Sep 17 03:01:05.473557 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:05.473527 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-lgz4q_2c1f21d1-9b7f-4b9a-90f1-5668f7a90c4a/jobset-operator/0.log" Sep 17 03:01:08.482754 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:08.482723 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-549g9_ba06754f-a033-439f-be89-35e19893ad02/migrator/0.log" Sep 17 03:01:08.501879 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:08.501849 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-549g9_ba06754f-a033-439f-be89-35e19893ad02/graceful-termination/0.log" Sep 17 03:01:08.674219 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:08.674193 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9wqcf/perf-node-gather-daemonset-txv9p" Sep 17 03:01:08.780828 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:08.780732 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-v52nt_f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a/kube-storage-version-migrator-operator/1.log" Sep 17 03:01:08.782529 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:08.782502 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-v52nt_f1e6cb98-c7fa-4bb7-9dbd-2abcde9cae0a/kube-storage-version-migrator-operator/0.log" Sep 17 03:01:09.812386 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.812360 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/kube-multus-additional-cni-plugins/0.log" Sep 17 03:01:09.832018 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.831997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/egress-router-binary-copy/0.log" Sep 17 03:01:09.850877 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.850857 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/cni-plugins/0.log" Sep 17 03:01:09.872665 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.872642 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/bond-cni-plugin/0.log" Sep 17 03:01:09.895461 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.895400 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/routeoverride-cni/0.log" Sep 17 03:01:09.920236 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.920211 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/whereabouts-cni-bincopy/0.log" Sep 17 03:01:09.942403 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:09.942375 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp7mc_dc9fd7c0-94f4-492f-81aa-2c374e3c1d2d/whereabouts-cni/0.log" Sep 17 03:01:10.203798 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:10.203762 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q4hvp_29bad9c7-5fa1-49e7-afdf-df2057e1a172/kube-multus/0.log" Sep 17 03:01:10.224329 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:10.224303 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-png44_ed18f6dd-2d32-4ec6-8a72-333b52cb92f6/network-metrics-daemon/0.log" Sep 17 03:01:10.243666 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:10.243647 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-png44_ed18f6dd-2d32-4ec6-8a72-333b52cb92f6/kube-rbac-proxy/0.log" Sep 17 03:01:11.306894 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.306821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-controller/0.log" Sep 17 03:01:11.320865 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.320840 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/1.log" Sep 17 03:01:11.320865 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.320860 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovn-acl-logging/0.log" Sep 17 03:01:11.343909 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.343885 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/kube-rbac-proxy-node/0.log" Sep 17 03:01:11.370105 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.370082 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 03:01:11.385524 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.385509 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/northd/0.log" Sep 17 03:01:11.404083 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.404061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/nbdb/0.log" Sep 17 03:01:11.422186 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.422166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/sbdb/0.log" Sep 17 03:01:11.475285 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:11.475251 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rsl82_54bd5264-c5a7-4e7b-a25b-03a168dc3759/ovnkube-controller/0.log" Sep 17 03:01:12.758181 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:12.758148 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6k7zp_b61bcaa3-28d6-4fcb-97f7-7f9384263d15/network-check-target-container/0.log" Sep 17 03:01:13.673948 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:13.673921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kgwqn_dd9f9c72-022a-4baa-a5fb-b769e8f53654/iptables-alerter/0.log" Sep 17 03:01:14.344634 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:14.344606 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mbcrz_e140c3d8-477f-4390-9433-ef93f5af4b13/tuned/0.log" Sep 17 03:01:16.020744 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:16.020714 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-268zh_5cc32ece-b97a-4ece-b2ab-da7f60e958d0/cluster-samples-operator/0.log" Sep 17 03:01:16.035064 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:16.035040 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-268zh_5cc32ece-b97a-4ece-b2ab-da7f60e958d0/cluster-samples-operator-watch/0.log" Sep 17 03:01:17.262622 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:17.262589 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-568869fdc5-66nv8_ad64adcd-1d0c-4e5d-98ee-38008d66f962/service-ca-controller/0.log" Sep 17 03:01:17.740508 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:17.740473 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-rxp6q_714e71ce-e745-4833-b083-924cb983da2e/csi-driver/0.log" Sep 17 03:01:17.758258 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:17.758228 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-rxp6q_714e71ce-e745-4833-b083-924cb983da2e/csi-node-driver-registrar/0.log" Sep 17 03:01:17.775929 ip-10-0-135-174 kubenswrapper[2580]: I0917 03:01:17.775893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-rxp6q_714e71ce-e745-4833-b083-924cb983da2e/csi-liveness-probe/0.log"