Sep 17 17:31:45.512438 ip-10-0-132-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 17:31:45.512452 ip-10-0-132-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 17:31:45.512462 ip-10-0-132-90 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 17:31:45.512672 ip-10-0-132-90 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 17:31:56.960772 ip-10-0-132-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 17:31:56.960789 ip-10-0-132-90 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d6e26555914d4861b93d6cbad8038a63 -- Sep 17 17:33:59.300780 ip-10-0-132-90 systemd[1]: Starting Kubernetes Kubelet... Sep 17 17:34:02.836787 ip-10-0-132-90 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:02.836787 ip-10-0-132-90 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 17:34:02.836787 ip-10-0-132-90 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:02.836787 ip-10-0-132-90 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 17:34:02.836787 ip-10-0-132-90 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:02.837698 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.836872 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 17:34:02.840824 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840804 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:02.840824 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840822 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:02.840824 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840827 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840830 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840834 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840837 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840840 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840843 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840846 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840849 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840852 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840855 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840864 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840867 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840870 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840873 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840876 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840878 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840881 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840884 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840886 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840889 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:02.840919 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840892 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840896 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840899 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840901 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840904 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840907 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840910 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840912 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840915 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840918 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840922 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840925 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840928 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840931 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840935 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840938 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840941 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840944 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840946 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840949 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:02.841428 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840952 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840955 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840958 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840961 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840964 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840967 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840971 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840973 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840976 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840979 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840983 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840989 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840993 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.840997 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841002 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841005 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841008 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841011 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841014 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:02.842014 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841016 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841020 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841022 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841025 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841028 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841031 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841034 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841037 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841039 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841042 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841045 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841048 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841050 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841053 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841056 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841060 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841063 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841066 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841069 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841073 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:02.842597 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841076 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841079 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841082 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841085 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841087 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841090 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841093 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841097 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841100 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841103 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841106 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841109 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841111 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841114 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841119 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841122 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841125 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841129 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841854 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:02.843109 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841861 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841864 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841867 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841872 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841875 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841878 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841881 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841884 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841888 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841893 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841897 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841900 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841902 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841905 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841908 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841911 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841914 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841916 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841919 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:02.843607 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841922 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841925 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841928 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841931 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841934 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841936 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841939 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841942 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841945 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841949 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841951 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841954 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841957 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841960 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841962 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841965 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841967 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841970 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841973 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841976 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:02.844119 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841979 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841982 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841985 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841988 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841992 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841994 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.841997 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842000 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842002 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842005 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842008 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842010 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842013 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842016 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842019 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842022 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842025 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842028 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842031 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842034 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:02.844644 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842037 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842040 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842042 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842045 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842048 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842050 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842053 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842059 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842062 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842065 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842068 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842071 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842073 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842078 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842081 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842083 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842086 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842091 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842095 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:02.845170 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842098 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842102 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842106 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842109 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842113 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842116 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842119 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842122 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842126 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842129 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842132 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842134 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842137 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842140 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842143 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842146 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842150 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842152 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842155 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842158 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:02.845687 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842577 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842583 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842586 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842589 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842592 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842595 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842598 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842601 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842604 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842608 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842611 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842614 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842617 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842620 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842623 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842626 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842629 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842631 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842635 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842638 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:02.846210 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842641 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842644 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842648 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842652 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842655 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842658 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842661 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842665 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842667 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842670 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842673 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842676 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842680 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842683 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842685 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842688 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842691 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842694 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842697 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842700 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:02.846793 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842702 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842705 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842708 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842711 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842713 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842716 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842719 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842721 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842724 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842727 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842730 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842733 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842735 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842738 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842741 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842744 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842746 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842750 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842752 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842755 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:02.847303 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842758 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842760 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842763 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842766 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842769 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842772 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842775 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842778 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842780 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842783 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842787 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842791 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842794 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842798 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842801 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842805 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842808 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842811 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842814 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:02.847841 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842817 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842820 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842822 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842825 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842828 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842831 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842833 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842836 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842839 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842842 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842845 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842847 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842850 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842854 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842857 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842861 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842864 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842867 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842869 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.842872 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:02.848338 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.842948 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.842987 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.842994 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.842999 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843003 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843006 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843011 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843015 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843019 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843023 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843027 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843030 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843034 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843037 2580 flags.go:64] FLAG: --cgroup-root="" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843040 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843043 2580 flags.go:64] FLAG: --client-ca-file="" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843046 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843049 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843053 2580 flags.go:64] FLAG: --cluster-domain="" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843056 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843060 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843063 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843067 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843070 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 17:34:02.848875 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843073 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843076 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843080 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843083 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843086 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843089 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843093 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843096 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843100 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843103 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843106 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843109 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843112 2580 flags.go:64] FLAG: --enable-server="true" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843116 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843125 2580 flags.go:64] FLAG: --event-burst="100" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843129 2580 flags.go:64] FLAG: --event-qps="50" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843131 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843134 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843138 2580 flags.go:64] FLAG: --eviction-hard="" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843142 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843145 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843148 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843151 2580 flags.go:64] FLAG: --eviction-soft="" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843154 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843157 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 17:34:02.849531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843161 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843163 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843166 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843172 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843175 2580 flags.go:64] FLAG: --feature-gates="" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843179 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843182 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843186 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843189 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843193 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843196 2580 flags.go:64] FLAG: --help="false" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843200 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-90.ec2.internal" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843203 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843208 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843211 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843215 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843219 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843222 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843225 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843228 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843231 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843234 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843238 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843241 2580 flags.go:64] FLAG: --kube-reserved="" Sep 17 17:34:02.850227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843244 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843247 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843251 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843254 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843257 2580 flags.go:64] FLAG: --lock-file="" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843260 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843263 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843266 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843271 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843274 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843277 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843282 2580 flags.go:64] FLAG: --logging-format="text" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843285 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843289 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843292 2580 flags.go:64] FLAG: --manifest-url="" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843295 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843299 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843302 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843307 2580 flags.go:64] FLAG: --max-pods="110" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843310 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843313 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843318 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843321 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843324 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843327 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 17:34:02.850920 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843331 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843338 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843341 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843345 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843348 2580 flags.go:64] FLAG: --pod-cidr="" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843351 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843357 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843360 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843363 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843366 2580 flags.go:64] FLAG: --port="10250" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843370 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843373 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05a1478ad13cf9d7a" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843376 2580 flags.go:64] FLAG: --qos-reserved="" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843380 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843383 2580 flags.go:64] FLAG: --register-node="true" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843386 2580 flags.go:64] FLAG: --register-with-taints="" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843390 2580 flags.go:64] FLAG: --registry-burst="10" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843393 2580 flags.go:64] FLAG: --registry-qps="5" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843396 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843401 2580 flags.go:64] FLAG: --reserved-memory="" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843405 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843408 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843411 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843414 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843417 2580 flags.go:64] FLAG: --runonce="false" Sep 17 17:34:02.851587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843420 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843423 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843427 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843431 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843434 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843437 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843441 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843444 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843447 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843450 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843453 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843456 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843459 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843462 2580 flags.go:64] FLAG: --system-cgroups="" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843465 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843485 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843489 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843492 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843497 2580 flags.go:64] FLAG: --tls-min-version="" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843500 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843503 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843506 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843510 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843513 2580 flags.go:64] FLAG: --v="2" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843517 2580 flags.go:64] FLAG: --version="false" Sep 17 17:34:02.852228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843521 2580 flags.go:64] FLAG: --vmodule="" Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843526 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.843529 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843646 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843650 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843654 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843657 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843661 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843664 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843667 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843673 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843677 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843688 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843691 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843695 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843698 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843701 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843703 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843706 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843709 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:02.853060 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843712 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843715 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843718 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843721 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843723 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843726 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843730 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843732 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843735 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843738 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843741 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843746 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843749 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843756 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843759 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843762 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843765 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843768 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843772 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843774 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:02.853921 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843778 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843781 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843786 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843789 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843792 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843795 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843798 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843801 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843804 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843806 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843809 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843812 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843815 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843818 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843821 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843824 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843827 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843829 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843832 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843836 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:02.854456 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843838 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843841 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843844 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843847 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843850 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843854 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843857 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843859 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843862 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843865 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843868 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843871 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843874 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843876 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843880 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843883 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843886 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843889 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843893 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843895 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:02.854991 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843899 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843901 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843904 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843907 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843910 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843913 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843915 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843918 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843921 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843924 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843927 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843929 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843933 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843935 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843938 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843941 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843943 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843948 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843950 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:02.855520 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843953 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843956 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.843960 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.844694 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.854740 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.854759 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.854782 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.854791 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854850 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854856 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854860 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854863 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854868 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854873 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:02.856003 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854876 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854880 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854883 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854886 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854889 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854892 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854895 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854897 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854900 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854903 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854906 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854909 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854912 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854916 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854918 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854921 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854924 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854928 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854930 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854933 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:02.856378 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854936 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854939 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854941 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854945 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854948 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854951 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854954 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854957 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854960 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854963 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854966 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854968 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854971 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854974 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854977 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854980 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854983 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854985 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854988 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854991 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:02.856903 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854994 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.854997 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855000 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855005 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855009 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855012 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855015 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855018 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855021 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855024 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855027 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855030 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855033 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855036 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855039 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855042 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855045 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855048 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855051 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:02.857413 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855054 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855056 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855059 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855062 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855065 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855068 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855070 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855073 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855076 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855079 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855081 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855084 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855087 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855089 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855093 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855096 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855099 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855102 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855105 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:02.857906 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855108 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855116 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855119 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855122 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855125 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855128 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855131 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855134 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855137 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855140 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855143 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855147 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855150 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855154 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:02.858395 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855158 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.855163 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855298 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855304 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855307 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855310 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855315 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855320 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855323 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855326 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855329 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855332 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855335 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855337 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:02.858781 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855342 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855345 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855348 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855352 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855354 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855357 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855360 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855363 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855367 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855370 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855372 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855376 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855378 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855382 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855387 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855390 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855394 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855397 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855399 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:02.859140 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855402 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855405 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855408 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855411 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855414 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855417 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855420 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855422 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855425 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855428 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855430 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855433 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855435 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855438 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855442 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855445 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855447 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855450 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855452 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855455 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:02.859713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855458 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855461 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855463 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855466 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855468 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855485 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855488 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855491 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855494 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855497 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855499 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855502 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855505 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855508 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855511 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855513 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855516 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855519 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855522 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855525 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:02.860232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855527 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855530 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855534 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855537 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855539 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855542 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855545 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855548 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855551 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855554 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855556 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855559 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855562 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855564 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855567 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855570 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855572 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855575 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855578 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855581 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:02.860767 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855584 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855587 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855590 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855592 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855595 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855598 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855601 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:02.855604 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.855610 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.855720 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.858016 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.858925 2580 server.go:1019] "Starting client certificate rotation" Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.859033 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:34:02.861263 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.859836 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:34:02.863293 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.863277 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:34:02.864524 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.864505 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:34:02.869189 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.869168 2580 log.go:25] "Validated CRI v1 runtime API" Sep 17 17:34:02.871578 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.871556 2580 log.go:25] "Validated CRI v1 image API" Sep 17 17:34:02.872553 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.872533 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 17:34:02.877665 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.877643 2580 fs.go:135] Filesystem UUIDs: map[356d91b5-0089-4878-b29c-62246219c791:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b3393830-01fa-4fb9-a7c1-e07a77713c67:/dev/nvme0n1p3] Sep 17 17:34:02.877665 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.877661 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 17:34:02.883653 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.883533 2580 manager.go:216] Machine: {Timestamp:2026-09-17 17:34:02.883006286 +0000 UTC m=+2.059400383 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3205093 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2515d4d9bd32c01d95a5f08d3bb0c1 SystemUUID:ec2515d4-d9bd-32c0-1d95-a5f08d3bb0c1 BootID:d6e26555-914d-4861-b93d-6cbad8038a63 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e2:58:60:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e2:58:60:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:61:76:36:89:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 17:34:02.883653 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.883643 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 17:34:02.883821 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.883761 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 17:34:02.886000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.885973 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 17:34:02.886160 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.886002 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 17:34:02.887506 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.887496 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 17:34:02.887548 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.887509 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 17:34:02.887548 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.887517 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:34:02.887548 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.887527 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:34:02.887633 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.887594 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 17:34:02.893033 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.893019 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:34:02.894153 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.894129 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 17:34:02.894250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.894218 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 17 17:34:02.894250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.894248 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 17:34:02.894340 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.894272 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 17:34:02.894340 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.894287 2580 kubelet.go:398] "Adding apiserver pod source" Sep 17 17:34:02.894340 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.894300 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 17:34:02.897289 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.897267 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:34:02.897576 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.897347 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:34:02.897984 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.897963 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:34:02.899816 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.899798 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 17:34:02.902785 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.902769 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 17:34:02.902853 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.902801 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903883 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903899 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903905 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903911 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903920 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903926 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903940 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903945 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 17:34:02.903941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903951 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 17:34:02.904331 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903957 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 17:34:02.904331 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903966 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 17:34:02.904331 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903971 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 17:34:02.904331 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.903995 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 17:34:02.904331 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.904000 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 17:34:02.907488 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.907459 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 17:34:02.907689 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.907669 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 17:34:02.907763 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.907737 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 17:34:02.907805 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.907782 2580 server.go:1268] "Started kubelet" Sep 17 17:34:02.907885 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.907857 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 17:34:02.907935 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.907885 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 17:34:02.907984 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.907946 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 17:34:02.908599 ip-10-0-132-90 systemd[1]: Started Kubernetes Kubelet. Sep 17 17:34:02.909772 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.909752 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 17 17:34:02.912104 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.912085 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 17:34:02.914061 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.914037 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 17:34:02.917925 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.917906 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 17:34:02.917925 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.917924 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 17:34:02.918104 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.917986 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:02.918636 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918614 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 17:34:02.918636 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918616 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 17:34:02.918793 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918647 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 17:34:02.918847 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918838 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 17 17:34:02.918892 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918850 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 17 17:34:02.918938 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918922 2580 factory.go:55] Registering systemd factory Sep 17 17:34:02.918992 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.918938 2580 factory.go:223] Registration of the systemd container factory successfully Sep 17 17:34:02.919180 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.919159 2580 factory.go:153] Registering CRI-O factory Sep 17 17:34:02.919180 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.919180 2580 factory.go:223] Registration of the crio container factory successfully Sep 17 17:34:02.919319 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.919232 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 17:34:02.919319 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.919252 2580 factory.go:103] Registering Raw factory Sep 17 17:34:02.919319 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.919268 2580 manager.go:1196] Started watching for new ooms in manager Sep 17 17:34:02.919813 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.919733 2580 manager.go:349] Starting recovery of all containers Sep 17 17:34:02.942598 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.942575 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7767h" Sep 17 17:34:02.945189 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.945162 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 17:34:02.945456 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.945426 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 17:34:02.946696 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.946671 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7767h" Sep 17 17:34:02.950343 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.950323 2580 manager.go:354] Recovery completed Sep 17 17:34:02.954433 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.954420 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:02.956042 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956026 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:02.956146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956060 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:02.956146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956074 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:02.956663 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956648 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 17:34:02.956663 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956662 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 17:34:02.956763 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956663 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:02.956763 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.956676 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:34:02.957313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.957300 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:02.957368 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.957324 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:02.957368 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.957334 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:02.958863 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.958850 2580 policy_none.go:49] "None policy: Start" Sep 17 17:34:02.958910 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.958867 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 17:34:02.958910 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.958878 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 17:34:02.961139 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.961127 2580 policy_none.go:47] "Start" Sep 17 17:34:02.998046 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998032 2580 manager.go:337] "Starting Device Plugin manager" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.998071 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998084 2580 server.go:87] "Starting device plugin registration server" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998311 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998334 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998443 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998519 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:02.998528 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.999067 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 17:34:03.015699 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:02.999112 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.075567 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.075539 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 17:34:03.076895 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.076873 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 17:34:03.076979 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.076924 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 17:34:03.076979 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.076951 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 17:34:03.077090 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.076995 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 17:34:03.079199 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.079180 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:03.098587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.098427 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:03.099273 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.099257 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:03.099344 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.099286 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:03.099344 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.099301 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:03.099344 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.099322 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.117936 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.117920 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.117983 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.117939 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-90.ec2.internal\": node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.138540 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.138522 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.177359 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.177335 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal"] Sep 17 17:34:03.177432 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.177394 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:03.178858 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.178844 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:03.178916 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.178869 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:03.178916 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.178880 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:03.180722 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.180710 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:03.180857 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.180843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.180907 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.180896 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:03.181373 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.181358 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:03.181460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.181374 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:03.181460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.181380 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:03.181460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.181390 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:03.181460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.181395 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:03.181460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.181399 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:03.183879 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.183864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.183935 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.183888 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:03.184504 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.184486 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:03.184610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.184517 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:03.184610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.184530 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:03.207097 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.207076 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-90.ec2.internal\" not found" node="ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.211426 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.211415 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-90.ec2.internal\" not found" node="ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.221078 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.221062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/970278068a61198f811d4e0e33bb9518-config\") pod \"kube-apiserver-proxy-ip-10-0-132-90.ec2.internal\" (UID: \"970278068a61198f811d4e0e33bb9518\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.221131 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.221085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d28ac7166c9a5b85e33b56c3b1f606a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal\" (UID: \"7d28ac7166c9a5b85e33b56c3b1f606a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.221131 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.221102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d28ac7166c9a5b85e33b56c3b1f606a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal\" (UID: \"7d28ac7166c9a5b85e33b56c3b1f606a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.239060 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.239040 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.321375 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.321356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/970278068a61198f811d4e0e33bb9518-config\") pod \"kube-apiserver-proxy-ip-10-0-132-90.ec2.internal\" (UID: \"970278068a61198f811d4e0e33bb9518\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.321465 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.321380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d28ac7166c9a5b85e33b56c3b1f606a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal\" (UID: \"7d28ac7166c9a5b85e33b56c3b1f606a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.321465 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.321397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d28ac7166c9a5b85e33b56c3b1f606a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal\" (UID: \"7d28ac7166c9a5b85e33b56c3b1f606a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.321465 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.321442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d28ac7166c9a5b85e33b56c3b1f606a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal\" (UID: \"7d28ac7166c9a5b85e33b56c3b1f606a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.321465 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.321453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/970278068a61198f811d4e0e33bb9518-config\") pod \"kube-apiserver-proxy-ip-10-0-132-90.ec2.internal\" (UID: \"970278068a61198f811d4e0e33bb9518\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.321608 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.321475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d28ac7166c9a5b85e33b56c3b1f606a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal\" (UID: \"7d28ac7166c9a5b85e33b56c3b1f606a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.339493 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.339464 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.440239 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.440176 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.517230 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.517201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.517230 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.517225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" Sep 17 17:34:03.540545 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.540527 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.640825 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.640786 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.719515 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.719462 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:03.741108 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.741081 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.809853 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.809824 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:03.841919 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.841890 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.858853 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.858828 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 17:34:03.858972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.858946 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:34:03.858972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.858956 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:34:03.859067 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.858959 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:34:03.942450 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:03.942418 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:03.952610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.952581 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:29:03 +0000 UTC" deadline="2028-05-08 06:51:41.092390318 +0000 UTC" Sep 17 17:34:03.952610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:03.952607 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14365h17m37.139785836s" Sep 17 17:34:04.043397 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.043363 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:04.143687 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.143654 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:04.144984 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:04.144954 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970278068a61198f811d4e0e33bb9518.slice/crio-742d56695799dde6628ce9a563d2e032416fca5c1e6111722385b767c90cc479 WatchSource:0}: Error finding container 742d56695799dde6628ce9a563d2e032416fca5c1e6111722385b767c90cc479: Status 404 returned error can't find the container with id 742d56695799dde6628ce9a563d2e032416fca5c1e6111722385b767c90cc479 Sep 17 17:34:04.145619 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:04.145597 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d28ac7166c9a5b85e33b56c3b1f606a.slice/crio-81a5e40d1d0b6d5b9654940b721a3ee0c97c5ecc880420765a3429f4250c2933 WatchSource:0}: Error finding container 81a5e40d1d0b6d5b9654940b721a3ee0c97c5ecc880420765a3429f4250c2933: Status 404 returned error can't find the container with id 81a5e40d1d0b6d5b9654940b721a3ee0c97c5ecc880420765a3429f4250c2933 Sep 17 17:34:04.152797 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.152781 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:34:04.244582 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.244549 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:04.345832 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.345813 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:04.446009 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.445983 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-90.ec2.internal\" not found" Sep 17 17:34:04.502557 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.502535 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:04.518333 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.518310 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" Sep 17 17:34:04.531042 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.531022 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:34:04.532283 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.532269 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" Sep 17 17:34:04.539005 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.538985 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:34:04.896533 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.896395 2580 apiserver.go:52] "Watching apiserver" Sep 17 17:34:04.903088 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.903049 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 17:34:04.903478 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.903451 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-h6fzd","kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mncms","openshift-multus/multus-additional-cni-plugins-4kp9x","openshift-multus/network-metrics-daemon-76whh","openshift-ovn-kubernetes/ovnkube-node-ncbx8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4","openshift-dns/node-resolver-m6zw8","openshift-image-registry/node-ca-g8sj6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal","openshift-multus/multus-b7bv8","openshift-network-diagnostics/network-check-target-48pl7","openshift-network-operator/iptables-alerter-j59qq","kube-system/global-pull-secret-syncer-scddx"] Sep 17 17:34:04.906089 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.906069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.906358 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.906336 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:04.909023 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.908473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:04.909023 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.908550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 17:34:04.909023 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.908814 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qgp6d\"" Sep 17 17:34:04.909362 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.909279 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.909362 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.909308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.910994 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.910966 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6dzlz\"" Sep 17 17:34:04.911762 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.911730 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.912654 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.912454 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.913051 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.913030 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 17:34:04.913216 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.911236 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.914209 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.914190 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gpmfh\"" Sep 17 17:34:04.914496 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.914456 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.914877 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.914855 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.915522 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.915238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.917395 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.917373 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.917750 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.917728 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:04.917842 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.917804 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:04.917931 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.917910 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 17:34:04.918339 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.918318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.918636 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.918617 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gvdb9\"" Sep 17 17:34:04.918898 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.918879 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 17:34:04.919041 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.919024 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 17:34:04.919333 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.919317 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 17:34:04.920358 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.920338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.922811 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.922685 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 17:34:04.922811 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.922702 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 17:34:04.922811 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.922790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p9w5b\"" Sep 17 17:34:04.923215 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.922998 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 17:34:04.923215 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.923096 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.923215 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.923102 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 17:34:04.923215 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.923101 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.923465 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.923449 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:04.927059 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.925539 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.927059 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.925933 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.927059 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.926025 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 17:34:04.927059 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.926247 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7s95z\"" Sep 17 17:34:04.927059 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.926331 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:04.928590 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.928572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:04.928788 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.928760 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:04.929235 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.929130 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lslh7\"" Sep 17 17:34:04.929235 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.929211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 17:34:04.929462 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.929439 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 17:34:04.930933 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.930909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.930950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-ovn\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.930977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ff0f726-582d-4204-b757-35b4575cd629-host-slash\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:04.931032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-systemd\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.931032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-lib-modules\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.931032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-tuned\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-kubelet\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-var-lib-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-node-log\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-cni-bin\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysctl-conf\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d92056c-7f6a-404f-ab94-e9ced9caa60f-tmp\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-run-netns\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-registration-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.931355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-systemd-units\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdf25810-be21-472f-8600-5beda9359004-ovn-node-metrics-cert\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-socket-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-sys-fs\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlkc9\" (UniqueName: \"kubernetes.io/projected/9acedd0f-0c3e-42de-87b2-32862a55b0bb-kube-api-access-nlkc9\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-kubernetes\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysctl-d\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cnibin\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-cni-netd\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-env-overrides\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-device-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ff0f726-582d-4204-b757-35b4575cd629-iptables-alerter-script\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-modprobe-d\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysconfig\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-run\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-sys\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5njtb\" (UniqueName: \"kubernetes.io/projected/4d92056c-7f6a-404f-ab94-e9ced9caa60f-kube-api-access-5njtb\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931865 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-system-cni-dir\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.931991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-slash\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-log-socket\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-ovnkube-config\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-ovnkube-script-lib\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8xx\" (UniqueName: \"kubernetes.io/projected/5ff0f726-582d-4204-b757-35b4575cd629-kube-api-access-cg8xx\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-host\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd5vz\" (UniqueName: \"kubernetes.io/projected/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-kube-api-access-cd5vz\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-systemd\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.932752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshpx\" (UniqueName: \"kubernetes.io/projected/cdf25810-be21-472f-8600-5beda9359004-kube-api-access-qshpx\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-var-lib-kubelet\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnf8\" (UniqueName: \"kubernetes.io/projected/2d8eadcd-005e-4f1f-91c0-076b0498988d-kube-api-access-9gnf8\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-etc-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.932926 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.933206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.933345 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jvshz\"" Sep 17 17:34:04.933439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.933421 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 17:34:04.934055 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.934038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b7bv8" Sep 17 17:34:04.936293 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.936275 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mjm9f\"" Sep 17 17:34:04.936562 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.936544 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 17:34:04.937247 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.937226 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:04.937346 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:04.937289 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:04.981183 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.981156 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gp7p" Sep 17 17:34:04.994818 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:04.994794 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gp7p" Sep 17 17:34:05.020567 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.020527 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 17:34:05.033191 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-run\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.033297 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-system-cni-dir\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.033297 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-ovnkube-config\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.033297 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-ovnkube-script-lib\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.033297 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-system-cni-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.033297 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-socket-dir-parent\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/960f710a-ef19-42de-bc76-782c41e594c0-multus-daemon-config\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-log-socket\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-run\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd9648a-85f9-4872-9769-1de2af2258cc-agent-certs\") pod \"konnectivity-agent-h6fzd\" (UID: \"6fd9648a-85f9-4872-9769-1de2af2258cc\") " pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-system-cni-dir\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd9648a-85f9-4872-9769-1de2af2258cc-konnectivity-ca\") pod \"konnectivity-agent-h6fzd\" (UID: \"6fd9648a-85f9-4872-9769-1de2af2258cc\") " pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-log-socket\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrcxt\" (UniqueName: \"kubernetes.io/projected/99c43776-aa7e-485b-9b2a-32e2acca7601-kube-api-access-hrcxt\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-etc-kubernetes\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.033613 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd5vz\" (UniqueName: \"kubernetes.io/projected/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-kube-api-access-cd5vz\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hfc5\" (UniqueName: \"kubernetes.io/projected/af388933-e192-4d07-82db-3a014715264b-kube-api-access-6hfc5\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-var-lib-kubelet\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-ovn\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af388933-e192-4d07-82db-3a014715264b-serviceca\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-ovn\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-kubelet\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-var-lib-kubelet\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-conf-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-systemd\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.033964 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-kubelet\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-var-lib-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034042 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-systemd\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-kubelet\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-node-log\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.034146 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-ovnkube-config\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-registration-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-ovnkube-script-lib\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af388933-e192-4d07-82db-3a014715264b-host\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-node-log\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-var-lib-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-registration-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-cni-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034316 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-k8s-cni-cncf-io\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysctl-conf\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-run-netns\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-sys-fs\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysctl-conf\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26e0676b-b698-4df9-95a3-0073b021ce55-dbus\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-run-netns\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-sys-fs\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.035020 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-cni-multus\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-kubernetes\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysctl-d\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034704 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cnibin\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-device-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/960f710a-ef19-42de-bc76-782c41e594c0-cni-binary-copy\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.034773 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.034837 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:34:05.534816842 +0000 UTC m=+4.711210942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034856 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysctl-d\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ff0f726-582d-4204-b757-35b4575cd629-iptables-alerter-script\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cnibin\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-kubernetes\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-modprobe-d\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.035915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-device-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysconfig\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-sys\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.034994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5njtb\" (UniqueName: \"kubernetes.io/projected/4d92056c-7f6a-404f-ab94-e9ced9caa60f-kube-api-access-5njtb\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-slash\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8xx\" (UniqueName: \"kubernetes.io/projected/5ff0f726-582d-4204-b757-35b4575cd629-kube-api-access-cg8xx\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-host\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-systemd\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qshpx\" (UniqueName: \"kubernetes.io/projected/cdf25810-be21-472f-8600-5beda9359004-kube-api-access-qshpx\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035248 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnf8\" (UniqueName: \"kubernetes.io/projected/2d8eadcd-005e-4f1f-91c0-076b0498988d-kube-api-access-9gnf8\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-etc-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26e0676b-b698-4df9-95a3-0073b021ce55-kubelet-config\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.036807 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-cni-bin\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035346 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ff0f726-582d-4204-b757-35b4575cd629-host-slash\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-lib-modules\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-sys\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-tuned\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-cni-bin\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-netns\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-slash\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfj49\" (UniqueName: \"kubernetes.io/projected/960f710a-ef19-42de-bc76-782c41e594c0-kube-api-access-kfj49\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d92056c-7f6a-404f-ab94-e9ced9caa60f-tmp\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-host\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlkc9\" (UniqueName: \"kubernetes.io/projected/9acedd0f-0c3e-42de-87b2-32862a55b0bb-kube-api-access-nlkc9\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c43776-aa7e-485b-9b2a-32e2acca7601-tmp-dir\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-multus-certs\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.037610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-systemd-units\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdf25810-be21-472f-8600-5beda9359004-ovn-node-metrics-cert\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-socket-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-run-systemd\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-hostroot\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-cni-netd\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-env-overrides\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99c43776-aa7e-485b-9b2a-32e2acca7601-hosts-file\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-cnibin\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.035923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ff0f726-582d-4204-b757-35b4575cd629-iptables-alerter-script\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-socket-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036309 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036577 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdf25810-be21-472f-8600-5beda9359004-env-overrides\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.038364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ff0f726-582d-4204-b757-35b4575cd629-host-slash\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036779 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-lib-modules\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-systemd-units\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036831 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-cni-bin\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.036968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9acedd0f-0c3e-42de-87b2-32862a55b0bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.037017 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-etc-openvswitch\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.037055 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdf25810-be21-472f-8600-5beda9359004-host-cni-netd\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.037060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-sysconfig\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.039252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.037122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-modprobe-d\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.040627 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.040556 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d92056c-7f6a-404f-ab94-e9ced9caa60f-etc-tuned\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.040752 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.040718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdf25810-be21-472f-8600-5beda9359004-ovn-node-metrics-cert\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.040918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.040890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d92056c-7f6a-404f-ab94-e9ced9caa60f-tmp\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.043918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.043882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd5vz\" (UniqueName: \"kubernetes.io/projected/bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5-kube-api-access-cd5vz\") pod \"multus-additional-cni-plugins-4kp9x\" (UID: \"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5\") " pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.049638 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.049582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnf8\" (UniqueName: \"kubernetes.io/projected/2d8eadcd-005e-4f1f-91c0-076b0498988d-kube-api-access-9gnf8\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:05.050442 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.050396 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlkc9\" (UniqueName: \"kubernetes.io/projected/9acedd0f-0c3e-42de-87b2-32862a55b0bb-kube-api-access-nlkc9\") pod \"aws-ebs-csi-driver-node-bn4l4\" (UID: \"9acedd0f-0c3e-42de-87b2-32862a55b0bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.051126 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.051083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5njtb\" (UniqueName: \"kubernetes.io/projected/4d92056c-7f6a-404f-ab94-e9ced9caa60f-kube-api-access-5njtb\") pod \"tuned-mncms\" (UID: \"4d92056c-7f6a-404f-ab94-e9ced9caa60f\") " pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.051683 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.051239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshpx\" (UniqueName: \"kubernetes.io/projected/cdf25810-be21-472f-8600-5beda9359004-kube-api-access-qshpx\") pod \"ovnkube-node-ncbx8\" (UID: \"cdf25810-be21-472f-8600-5beda9359004\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.051683 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.051643 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8xx\" (UniqueName: \"kubernetes.io/projected/5ff0f726-582d-4204-b757-35b4575cd629-kube-api-access-cg8xx\") pod \"iptables-alerter-j59qq\" (UID: \"5ff0f726-582d-4204-b757-35b4575cd629\") " pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.082128 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.082074 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" event={"ID":"970278068a61198f811d4e0e33bb9518","Type":"ContainerStarted","Data":"742d56695799dde6628ce9a563d2e032416fca5c1e6111722385b767c90cc479"} Sep 17 17:34:05.083659 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.083634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" event={"ID":"7d28ac7166c9a5b85e33b56c3b1f606a","Type":"ContainerStarted","Data":"81a5e40d1d0b6d5b9654940b721a3ee0c97c5ecc880420765a3429f4250c2933"} Sep 17 17:34:05.136199 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/960f710a-ef19-42de-bc76-782c41e594c0-cni-binary-copy\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136329 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:05.136329 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26e0676b-b698-4df9-95a3-0073b021ce55-kubelet-config\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.136329 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-cni-bin\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136329 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-netns\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfj49\" (UniqueName: \"kubernetes.io/projected/960f710a-ef19-42de-bc76-782c41e594c0-kube-api-access-kfj49\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136342 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-cni-bin\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136364 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26e0676b-b698-4df9-95a3-0073b021ce55-kubelet-config\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c43776-aa7e-485b-9b2a-32e2acca7601-tmp-dir\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-netns\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-multus-certs\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-hostroot\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99c43776-aa7e-485b-9b2a-32e2acca7601-hosts-file\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-cnibin\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136550 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-multus-certs\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-system-cni-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-socket-dir-parent\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.136602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/960f710a-ef19-42de-bc76-782c41e594c0-multus-daemon-config\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99c43776-aa7e-485b-9b2a-32e2acca7601-hosts-file\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd9648a-85f9-4872-9769-1de2af2258cc-agent-certs\") pod \"konnectivity-agent-h6fzd\" (UID: \"6fd9648a-85f9-4872-9769-1de2af2258cc\") " pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd9648a-85f9-4872-9769-1de2af2258cc-konnectivity-ca\") pod \"konnectivity-agent-h6fzd\" (UID: \"6fd9648a-85f9-4872-9769-1de2af2258cc\") " pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136668 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-system-cni-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136666 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-hostroot\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcxt\" (UniqueName: \"kubernetes.io/projected/99c43776-aa7e-485b-9b2a-32e2acca7601-kube-api-access-hrcxt\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136709 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-socket-dir-parent\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-etc-kubernetes\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136729 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c43776-aa7e-485b-9b2a-32e2acca7601-tmp-dir\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hfc5\" (UniqueName: \"kubernetes.io/projected/af388933-e192-4d07-82db-3a014715264b-kube-api-access-6hfc5\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136774 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/960f710a-ef19-42de-bc76-782c41e594c0-cni-binary-copy\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af388933-e192-4d07-82db-3a014715264b-serviceca\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-kubelet\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-conf-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af388933-e192-4d07-82db-3a014715264b-host\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-cni-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-k8s-cni-cncf-io\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26e0676b-b698-4df9-95a3-0073b021ce55-dbus\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.136943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-cni-multus\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137019 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-cni-multus\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137034 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-etc-kubernetes\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-var-lib-kubelet\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137100 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-host-run-k8s-cni-cncf-io\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137113 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/960f710a-ef19-42de-bc76-782c41e594c0-multus-daemon-config\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-conf-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137188 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-multus-cni-dir\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.137196 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26e0676b-b698-4df9-95a3-0073b021ce55-dbus\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af388933-e192-4d07-82db-3a014715264b-host\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137228 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af388933-e192-4d07-82db-3a014715264b-serviceca\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.137266 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:05.637248528 +0000 UTC m=+4.813642627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/960f710a-ef19-42de-bc76-782c41e594c0-cnibin\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.137988 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.137456 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd9648a-85f9-4872-9769-1de2af2258cc-konnectivity-ca\") pod \"konnectivity-agent-h6fzd\" (UID: \"6fd9648a-85f9-4872-9769-1de2af2258cc\") " pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.139655 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.139636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd9648a-85f9-4872-9769-1de2af2258cc-agent-certs\") pod \"konnectivity-agent-h6fzd\" (UID: \"6fd9648a-85f9-4872-9769-1de2af2258cc\") " pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.144834 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.144814 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:05.144951 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.144841 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:05.144951 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.144854 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:05.144951 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.144923 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:05.644908476 +0000 UTC m=+4.821302573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:05.148028 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.147971 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfj49\" (UniqueName: \"kubernetes.io/projected/960f710a-ef19-42de-bc76-782c41e594c0-kube-api-access-kfj49\") pod \"multus-b7bv8\" (UID: \"960f710a-ef19-42de-bc76-782c41e594c0\") " pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.148645 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.148624 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcxt\" (UniqueName: \"kubernetes.io/projected/99c43776-aa7e-485b-9b2a-32e2acca7601-kube-api-access-hrcxt\") pod \"node-resolver-m6zw8\" (UID: \"99c43776-aa7e-485b-9b2a-32e2acca7601\") " pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.148802 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.148783 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hfc5\" (UniqueName: \"kubernetes.io/projected/af388933-e192-4d07-82db-3a014715264b-kube-api-access-6hfc5\") pod \"node-ca-g8sj6\" (UID: \"af388933-e192-4d07-82db-3a014715264b\") " pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.221847 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.221825 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" Sep 17 17:34:05.231244 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.231225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j59qq" Sep 17 17:34:05.241431 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.241399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mncms" Sep 17 17:34:05.248013 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.247993 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" Sep 17 17:34:05.255977 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.255958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:05.272300 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.272275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8sj6" Sep 17 17:34:05.281090 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.281070 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:05.288886 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.288866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m6zw8" Sep 17 17:34:05.295666 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.295648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b7bv8" Sep 17 17:34:05.540701 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.540604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:05.540859 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.540750 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:05.540859 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.540817 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:34:06.540796257 +0000 UTC m=+5.717190360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:05.641714 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.641679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:05.641879 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.641807 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:05.641879 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.641872 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:06.641857718 +0000 UTC m=+5.818251802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:05.742698 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.742670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:05.742863 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.742823 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:05.742863 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.742844 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:05.742863 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.742855 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:05.743036 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:05.742920 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:06.74289805 +0000 UTC m=+5.919292150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:05.998330 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.998248 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:05 +0000 UTC" deadline="2028-02-28 19:01:34.185713318 +0000 UTC" Sep 17 17:34:05.998330 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:05.998278 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12697h27m28.187438619s" Sep 17 17:34:06.076037 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.075892 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf25810_be21_472f_8600_5beda9359004.slice/crio-dd8d1233bb1dc1e66bf7d1af75c3257740728d853e14a73a7c27662f347aab24 WatchSource:0}: Error finding container dd8d1233bb1dc1e66bf7d1af75c3257740728d853e14a73a7c27662f347aab24: Status 404 returned error can't find the container with id dd8d1233bb1dc1e66bf7d1af75c3257740728d853e14a73a7c27662f347aab24 Sep 17 17:34:06.081038 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.081012 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2ad0b5_f294_4f12_9f91_2089a7c4d8c5.slice/crio-4661205e981b9287d367a3d55c18dd1fd9eee9872ade00cd0b6d0cffb4c3159b WatchSource:0}: Error finding container 4661205e981b9287d367a3d55c18dd1fd9eee9872ade00cd0b6d0cffb4c3159b: Status 404 returned error can't find the container with id 4661205e981b9287d367a3d55c18dd1fd9eee9872ade00cd0b6d0cffb4c3159b Sep 17 17:34:06.082713 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.082659 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960f710a_ef19_42de_bc76_782c41e594c0.slice/crio-56f94b7d9ab01961dc4d4661d4a5298e93fd465c4105f3928f2bbc03f99575c6 WatchSource:0}: Error finding container 56f94b7d9ab01961dc4d4661d4a5298e93fd465c4105f3928f2bbc03f99575c6: Status 404 returned error can't find the container with id 56f94b7d9ab01961dc4d4661d4a5298e93fd465c4105f3928f2bbc03f99575c6 Sep 17 17:34:06.087820 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.087549 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff0f726_582d_4204_b757_35b4575cd629.slice/crio-9bcdc5ea6de92065ec76f832b9e46c17da9455f69bb7a68b5e284d000e0ca3ef WatchSource:0}: Error finding container 9bcdc5ea6de92065ec76f832b9e46c17da9455f69bb7a68b5e284d000e0ca3ef: Status 404 returned error can't find the container with id 9bcdc5ea6de92065ec76f832b9e46c17da9455f69bb7a68b5e284d000e0ca3ef Sep 17 17:34:06.089373 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.089340 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd9648a_85f9_4872_9769_1de2af2258cc.slice/crio-2d0a9d08444d9aa777e0e0d69056d986ac240e6c608ac9332c17b23319db63c8 WatchSource:0}: Error finding container 2d0a9d08444d9aa777e0e0d69056d986ac240e6c608ac9332c17b23319db63c8: Status 404 returned error can't find the container with id 2d0a9d08444d9aa777e0e0d69056d986ac240e6c608ac9332c17b23319db63c8 Sep 17 17:34:06.090104 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.090070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b7bv8" event={"ID":"960f710a-ef19-42de-bc76-782c41e594c0","Type":"ContainerStarted","Data":"56f94b7d9ab01961dc4d4661d4a5298e93fd465c4105f3928f2bbc03f99575c6"} Sep 17 17:34:06.091706 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.091516 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9acedd0f_0c3e_42de_87b2_32862a55b0bb.slice/crio-36449d12faac5e99a51a5bcc061a9a7649a460216145b13a691d435fcb1f4596 WatchSource:0}: Error finding container 36449d12faac5e99a51a5bcc061a9a7649a460216145b13a691d435fcb1f4596: Status 404 returned error can't find the container with id 36449d12faac5e99a51a5bcc061a9a7649a460216145b13a691d435fcb1f4596 Sep 17 17:34:06.092251 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.092185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerStarted","Data":"4661205e981b9287d367a3d55c18dd1fd9eee9872ade00cd0b6d0cffb4c3159b"} Sep 17 17:34:06.093531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.093508 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"dd8d1233bb1dc1e66bf7d1af75c3257740728d853e14a73a7c27662f347aab24"} Sep 17 17:34:06.114634 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.114611 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf388933_e192_4d07_82db_3a014715264b.slice/crio-0714bd011d654000c1aad88c248ac2f13404ff22f5400b53e65e72ab90feab5d WatchSource:0}: Error finding container 0714bd011d654000c1aad88c248ac2f13404ff22f5400b53e65e72ab90feab5d: Status 404 returned error can't find the container with id 0714bd011d654000c1aad88c248ac2f13404ff22f5400b53e65e72ab90feab5d Sep 17 17:34:06.115572 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:06.115442 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c43776_aa7e_485b_9b2a_32e2acca7601.slice/crio-26c88a18a5847f9c575d8435fbcc42774a930c44e358193b77283c6dfe28f550 WatchSource:0}: Error finding container 26c88a18a5847f9c575d8435fbcc42774a930c44e358193b77283c6dfe28f550: Status 404 returned error can't find the container with id 26c88a18a5847f9c575d8435fbcc42774a930c44e358193b77283c6dfe28f550 Sep 17 17:34:06.352587 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.352409 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:06.526896 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.526856 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:06.549971 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.549915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:06.550139 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.550091 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:06.550139 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.550140 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:34:08.550126551 +0000 UTC m=+7.726520635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:06.651402 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.650827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:06.651402 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.650979 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:06.651402 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.651039 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:08.651021329 +0000 UTC m=+7.827415417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:06.752067 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.751922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:06.752221 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.752086 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:06.752221 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.752109 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:06.752221 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.752122 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:06.752221 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:06.752178 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:08.752158998 +0000 UTC m=+7.928553106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:06.999236 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.999098 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:05 +0000 UTC" deadline="2028-03-27 05:59:50.52083222 +0000 UTC" Sep 17 17:34:06.999236 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:06.999156 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13356h25m43.52168012s" Sep 17 17:34:07.077201 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.077174 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:07.077362 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:07.077297 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:07.077729 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.077710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:07.077837 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:07.077807 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:07.077907 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.077874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:07.077999 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:07.077979 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:07.125430 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.124957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" event={"ID":"970278068a61198f811d4e0e33bb9518","Type":"ContainerStarted","Data":"266610027a211017cfbb363a36017ad1e48677320b50b47f33c266fb5e904fea"} Sep 17 17:34:07.148319 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.148288 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m6zw8" event={"ID":"99c43776-aa7e-485b-9b2a-32e2acca7601","Type":"ContainerStarted","Data":"26c88a18a5847f9c575d8435fbcc42774a930c44e358193b77283c6dfe28f550"} Sep 17 17:34:07.153516 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.152533 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-90.ec2.internal" podStartSLOduration=3.152516202 podStartE2EDuration="3.152516202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:07.152169321 +0000 UTC m=+6.328563436" watchObservedRunningTime="2026-09-17 17:34:07.152516202 +0000 UTC m=+6.328910312" Sep 17 17:34:07.162910 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.162878 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8sj6" event={"ID":"af388933-e192-4d07-82db-3a014715264b","Type":"ContainerStarted","Data":"0714bd011d654000c1aad88c248ac2f13404ff22f5400b53e65e72ab90feab5d"} Sep 17 17:34:07.183158 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.182767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j59qq" event={"ID":"5ff0f726-582d-4204-b757-35b4575cd629","Type":"ContainerStarted","Data":"9bcdc5ea6de92065ec76f832b9e46c17da9455f69bb7a68b5e284d000e0ca3ef"} Sep 17 17:34:07.186604 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.186579 2580 generic.go:356] "Generic (PLEG): container finished" podID="7d28ac7166c9a5b85e33b56c3b1f606a" containerID="703f7036170316fa6fb37f3fa5fcc4f37c96e097558c29eac2530d11cb9c6c4d" exitCode=0 Sep 17 17:34:07.187408 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.187173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" event={"ID":"7d28ac7166c9a5b85e33b56c3b1f606a","Type":"ContainerDied","Data":"703f7036170316fa6fb37f3fa5fcc4f37c96e097558c29eac2530d11cb9c6c4d"} Sep 17 17:34:07.197694 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.197490 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" event={"ID":"9acedd0f-0c3e-42de-87b2-32862a55b0bb","Type":"ContainerStarted","Data":"36449d12faac5e99a51a5bcc061a9a7649a460216145b13a691d435fcb1f4596"} Sep 17 17:34:07.216233 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.216185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6fzd" event={"ID":"6fd9648a-85f9-4872-9769-1de2af2258cc","Type":"ContainerStarted","Data":"2d0a9d08444d9aa777e0e0d69056d986ac240e6c608ac9332c17b23319db63c8"} Sep 17 17:34:07.220884 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:07.220811 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mncms" event={"ID":"4d92056c-7f6a-404f-ab94-e9ced9caa60f","Type":"ContainerStarted","Data":"ba9edc7ba02955f669a48b31b04cceac30249a2349f8628c318ccf4d3c07a67c"} Sep 17 17:34:08.242493 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:08.242456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" event={"ID":"7d28ac7166c9a5b85e33b56c3b1f606a","Type":"ContainerStarted","Data":"7b0ee8ffbc09851753bc0009bfcd7445556545cb3bafe384a7815137710d0f98"} Sep 17 17:34:08.261859 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:08.261803 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-90.ec2.internal" podStartSLOduration=4.261783629 podStartE2EDuration="4.261783629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:08.260936705 +0000 UTC m=+7.437330813" watchObservedRunningTime="2026-09-17 17:34:08.261783629 +0000 UTC m=+7.438177734" Sep 17 17:34:08.568771 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:08.568734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:08.568944 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.568919 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:08.569002 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.568979 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:34:12.568962155 +0000 UTC m=+11.745356241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:08.669408 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:08.669361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:08.669623 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.669537 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:08.669623 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.669596 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:12.669579963 +0000 UTC m=+11.845974051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:08.770222 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:08.770169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:08.770389 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.770339 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:08.770389 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.770359 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:08.770389 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.770371 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:08.770580 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:08.770441 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:12.770423964 +0000 UTC m=+11.946818066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:09.078520 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:09.078477 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:09.078694 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:09.078616 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:09.079279 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:09.079261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:09.079441 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:09.079363 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:09.079441 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:09.079425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:09.079541 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:09.079489 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:11.078100 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:11.077994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:11.078100 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:11.078013 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:11.078100 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:11.078003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:11.078686 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:11.078111 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:11.078686 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:11.078220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:11.078686 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:11.078296 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:12.601050 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:12.601014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:12.601589 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.601192 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:12.601589 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.601261 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:34:20.601234427 +0000 UTC m=+19.777628511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:12.701606 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:12.701571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:12.701783 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.701751 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:12.701846 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.701809 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:20.701790403 +0000 UTC m=+19.878184491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:12.802694 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:12.802628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:12.802867 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.802824 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:12.802867 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.802840 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:12.802867 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.802853 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:12.803020 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:12.802907 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:20.802890608 +0000 UTC m=+19.979284701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:13.077953 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:13.077915 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:13.078122 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:13.078015 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:13.078236 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:13.078218 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:13.078352 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:13.078330 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:13.078423 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:13.078408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:13.078544 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:13.078484 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:15.078122 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:15.078082 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:15.078636 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:15.078082 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:15.078636 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:15.078208 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:15.078636 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:15.078241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:15.078636 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:15.078354 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:15.078636 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:15.078444 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:17.077996 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:17.077961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:17.077996 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:17.078002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:17.078567 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:17.077973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:17.078567 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:17.078075 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:17.078567 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:17.078145 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:17.078567 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:17.078201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:19.077447 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:19.077407 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:19.077832 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:19.077457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:19.077832 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:19.077424 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:19.077832 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:19.077539 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:19.077832 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:19.077606 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:19.077832 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:19.077686 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:20.658364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:20.658329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:20.658919 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.658506 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:20.658919 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.658578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:34:36.658559025 +0000 UTC m=+35.834953108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:20.758985 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:20.758949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:20.759128 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.759104 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:20.759182 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.759173 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:36.759155173 +0000 UTC m=+35.935549256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:20.860035 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:20.860006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:20.860182 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.860163 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:20.860247 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.860191 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:20.860247 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.860204 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:20.860342 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:20.860261 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:36.860241259 +0000 UTC m=+36.036635347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:21.077188 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:21.077155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:21.077351 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:21.077154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:21.077351 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:21.077290 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:21.077492 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:21.077354 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:21.077492 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:21.077162 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:21.077492 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:21.077446 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:23.079794 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.079077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:23.079794 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.079114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:23.079794 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:23.079187 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:23.079794 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.079088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:23.079794 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:23.079264 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:23.079794 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:23.079327 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:23.271031 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.271006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerStarted","Data":"77c4d42a019eec6953e6888a8f4d14241eadb1684e2be75a80bf6f250acac21a"} Sep 17 17:34:23.272610 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.272416 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"003d94cbf68d5c209ecee824397563d2dc32315c55d666f6aa97d49fe514a7c6"} Sep 17 17:34:23.273840 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.273815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" event={"ID":"9acedd0f-0c3e-42de-87b2-32862a55b0bb","Type":"ContainerStarted","Data":"63086c1fdab224015c14c8783b1b21fa021fabbb2b0b3ec2e88c0291511facbe"} Sep 17 17:34:23.275256 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.275226 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6fzd" event={"ID":"6fd9648a-85f9-4872-9769-1de2af2258cc","Type":"ContainerStarted","Data":"2df6386c119258c35fa7d558b9c2a216372d49c18ad25d89d0b8b6ecc70f593c"} Sep 17 17:34:23.276632 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.276612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mncms" event={"ID":"4d92056c-7f6a-404f-ab94-e9ced9caa60f","Type":"ContainerStarted","Data":"919d1c2871965b3dd6d521154e4ec7f4747390d2ba571175b86607eab39f3c02"} Sep 17 17:34:23.278124 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.278102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b7bv8" event={"ID":"960f710a-ef19-42de-bc76-782c41e594c0","Type":"ContainerStarted","Data":"cda8db01f4e9ceef1331c641255815a9719e7b5b276d8d9abeac0fe8c4dadd2b"} Sep 17 17:34:23.279526 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.279507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m6zw8" event={"ID":"99c43776-aa7e-485b-9b2a-32e2acca7601","Type":"ContainerStarted","Data":"9b255fc2be8efd0f691a888db80efd7ef44f3c06ac520d41cfdc1c1e359421c4"} Sep 17 17:34:23.281127 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.280912 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8sj6" event={"ID":"af388933-e192-4d07-82db-3a014715264b","Type":"ContainerStarted","Data":"5db9d889f1a4d25641d9cb057087a5b566bb2f2c316d04ff9e2eccd1a25870cc"} Sep 17 17:34:23.307553 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.307520 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mncms" podStartSLOduration=3.464074348 podStartE2EDuration="20.307508111s" totalImagesPullingTime="16.843433763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:23.307171656 +0000 UTC m=+22.483565784" watchObservedRunningTime="2026-09-17 17:34:23.307508111 +0000 UTC m=+22.483902272" Sep 17 17:34:23.322200 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.322168 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8sj6" podStartSLOduration=3.508373898 podStartE2EDuration="20.322157897s" totalImagesPullingTime="16.813783999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:23.32173901 +0000 UTC m=+22.498133113" watchObservedRunningTime="2026-09-17 17:34:23.322157897 +0000 UTC m=+22.498552001" Sep 17 17:34:23.338026 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.337984 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m6zw8" podStartSLOduration=3.522553335 podStartE2EDuration="20.337968286s" totalImagesPullingTime="16.815414951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:23.337210772 +0000 UTC m=+22.513604876" watchObservedRunningTime="2026-09-17 17:34:23.337968286 +0000 UTC m=+22.514362391" Sep 17 17:34:23.355367 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.355335 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h6fzd" podStartSLOduration=7.456833999 podStartE2EDuration="20.355325989s" totalImagesPullingTime="12.89849199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:23.355262613 +0000 UTC m=+22.531656738" watchObservedRunningTime="2026-09-17 17:34:23.355325989 +0000 UTC m=+22.531720093" Sep 17 17:34:23.372787 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:23.372573 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b7bv8" podStartSLOduration=3.483050095 podStartE2EDuration="20.372556232s" totalImagesPullingTime="16.889506137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:23.371975148 +0000 UTC m=+22.548369252" watchObservedRunningTime="2026-09-17 17:34:23.372556232 +0000 UTC m=+22.548950337" Sep 17 17:34:24.284531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.284499 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5" containerID="77c4d42a019eec6953e6888a8f4d14241eadb1684e2be75a80bf6f250acac21a" exitCode=0 Sep 17 17:34:24.285168 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.284580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerDied","Data":"77c4d42a019eec6953e6888a8f4d14241eadb1684e2be75a80bf6f250acac21a"} Sep 17 17:34:24.287229 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287210 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:34:24.287545 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287528 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdf25810-be21-472f-8600-5beda9359004" containerID="0e1e4f42f158dcc53672dbd5149f11232bd9f7617b9ac15ffc936248600b8ba5" exitCode=1 Sep 17 17:34:24.287627 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"e7fc2e5dad12c920c4905197b816d0609c5ba00d6d66eefe756aef291212d990"} Sep 17 17:34:24.287673 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"9d386734cc90d4f87322f983f1b2e313bdf6d26e8cc9319e89e974d2878d05df"} Sep 17 17:34:24.287706 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"7cbce512ef843b5c61090646b0899aaf9c7fb8e829d5809910cd7b5876f86462"} Sep 17 17:34:24.287736 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"1211c823454683f31796a13fd152fa018ce077ce053d21484a1371e358e8acf1"} Sep 17 17:34:24.287768 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.287760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerDied","Data":"0e1e4f42f158dcc53672dbd5149f11232bd9f7617b9ac15ffc936248600b8ba5"} Sep 17 17:34:24.504480 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:24.504460 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 17:34:25.009496 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.009369 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:34:24.504475945Z","UUID":"ba2e62ea-220f-400f-9599-9951f0cb3dce","Handler":null,"Name":"","Endpoint":""} Sep 17 17:34:25.011370 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.011015 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 17:34:25.011370 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.011045 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 17:34:25.077431 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.077138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:25.077431 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:25.077243 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:25.077431 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.077285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:25.077431 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:25.077375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:25.077431 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.077410 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:25.077731 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:25.077498 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:25.292249 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.292210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" event={"ID":"9acedd0f-0c3e-42de-87b2-32862a55b0bb","Type":"ContainerStarted","Data":"ba73320d876635bf0bc2d285f6a2f7ae93b51d15968f80cf0297bb4919204de6"} Sep 17 17:34:25.294080 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.294052 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j59qq" event={"ID":"5ff0f726-582d-4204-b757-35b4575cd629","Type":"ContainerStarted","Data":"6d2e4fe82be693609467de415067aa9ef6aef3ec623812ef1090b8dfe409efbf"} Sep 17 17:34:25.309491 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:25.309444 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j59qq" podStartSLOduration=5.468640905 podStartE2EDuration="22.309426028s" totalImagesPullingTime="16.840785123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:25.309161172 +0000 UTC m=+24.485555288" watchObservedRunningTime="2026-09-17 17:34:25.309426028 +0000 UTC m=+24.485820135" Sep 17 17:34:26.301049 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:26.301020 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:34:26.301567 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:26.301468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"1e0dae05bbee751285d716c5cf9d8318212e88e347d1a04266de9051406cd6fe"} Sep 17 17:34:26.303978 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:26.303951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" event={"ID":"9acedd0f-0c3e-42de-87b2-32862a55b0bb","Type":"ContainerStarted","Data":"4b3e6de4f58db1c42da0b69dcf7194bf114eec352ceaa09d9f53e4bb9418ead2"} Sep 17 17:34:26.323902 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:26.323857 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bn4l4" podStartSLOduration=4.432746133 podStartE2EDuration="23.323841741s" totalImagesPullingTime="18.891095608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:26.323530108 +0000 UTC m=+25.499924213" watchObservedRunningTime="2026-09-17 17:34:26.323841741 +0000 UTC m=+25.500235846" Sep 17 17:34:27.078214 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.078183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:27.078731 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.078183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:27.078731 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:27.078320 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:27.078731 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.078183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:27.078731 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:27.078382 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:27.078731 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:27.078467 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:27.115782 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.115754 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:27.116216 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.116200 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:27.306339 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.306309 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:27.306734 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:27.306584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h6fzd" Sep 17 17:34:28.312133 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:28.311970 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:34:28.312769 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:28.312537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"72239e1bb569e23b95e7903ebfdfaba12ba848dbd0274c1d5f3d1b88390a8317"} Sep 17 17:34:28.312903 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:28.312881 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:28.312972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:28.312960 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:28.313158 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:28.313140 2580 scope.go:117] "RemoveContainer" containerID="0e1e4f42f158dcc53672dbd5149f11232bd9f7617b9ac15ffc936248600b8ba5" Sep 17 17:34:28.338850 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:28.338830 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:29.077568 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.077534 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:29.077568 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.077556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:29.077780 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.077540 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:29.077780 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:29.077671 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:29.077780 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:29.077707 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:29.077890 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:29.077778 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:29.316299 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.316268 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5" containerID="1d43f139999427d71e1f84a7398aced963cb3599814def91a29dbd8d6415e943" exitCode=0 Sep 17 17:34:29.316820 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.316330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerDied","Data":"1d43f139999427d71e1f84a7398aced963cb3599814def91a29dbd8d6415e943"} Sep 17 17:34:29.320313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.320298 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:34:29.320699 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.320673 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" event={"ID":"cdf25810-be21-472f-8600-5beda9359004","Type":"ContainerStarted","Data":"7fa9b07af678ee5cdcd9755e9eec13dd04d8ad1a17552fc3d50b4baf80c9d889"} Sep 17 17:34:29.320791 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.320757 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:29.335198 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.335150 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:34:29.362860 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:29.362803 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" podStartSLOduration=9.502119272 podStartE2EDuration="26.362786616s" totalImagesPullingTime="16.860667344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:29.362479999 +0000 UTC m=+28.538874103" watchObservedRunningTime="2026-09-17 17:34:29.362786616 +0000 UTC m=+28.539180703" Sep 17 17:34:30.048320 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:30.048141 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-scddx"] Sep 17 17:34:30.048477 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:30.048385 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:30.048533 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:30.048492 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:30.052749 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:30.052722 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-76whh"] Sep 17 17:34:30.052860 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:30.052799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:30.052930 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:30.052880 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:30.057711 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:30.057692 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48pl7"] Sep 17 17:34:30.057799 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:30.057790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:30.057875 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:30.057859 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:31.327187 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:31.327158 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5" containerID="8ef185ab222739362b024e29af537bf6d08743661015864c884759733eaec35b" exitCode=0 Sep 17 17:34:31.327619 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:31.327235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerDied","Data":"8ef185ab222739362b024e29af537bf6d08743661015864c884759733eaec35b"} Sep 17 17:34:32.077184 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:32.077160 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:32.077184 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:32.077180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:32.077347 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:32.077274 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:32.077347 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:32.077308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:32.077460 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:32.077422 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:32.077557 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:32.077529 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:33.332779 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:33.332753 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5" containerID="65f5e961cac49462060bd99c6b8319997538ba5f4c918a1fbde5eee370ab7c36" exitCode=0 Sep 17 17:34:33.333137 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:33.332798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerDied","Data":"65f5e961cac49462060bd99c6b8319997538ba5f4c918a1fbde5eee370ab7c36"} Sep 17 17:34:34.078081 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:34.078049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:34.078246 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:34.078049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:34.078246 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:34.078049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:34.078246 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:34.078196 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:34.078379 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:34.078300 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:34.078448 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:34.078388 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:36.077938 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:36.077906 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:36.077938 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:36.077943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:36.078369 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.078024 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scddx" podUID="26e0676b-b698-4df9-95a3-0073b021ce55" Sep 17 17:34:36.078369 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.078052 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48pl7" podUID="a131a629-0149-4409-b083-a4dd34ea74d4" Sep 17 17:34:36.078369 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:36.078084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:36.078369 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.078165 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76whh" podUID="2d8eadcd-005e-4f1f-91c0-076b0498988d" Sep 17 17:34:36.678011 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:36.677966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:36.678218 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.678137 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:36.678218 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.678203 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs podName:2d8eadcd-005e-4f1f-91c0-076b0498988d nodeName:}" failed. No retries permitted until 2026-09-17 17:35:08.678187728 +0000 UTC m=+67.854581831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs") pod "network-metrics-daemon-76whh" (UID: "2d8eadcd-005e-4f1f-91c0-076b0498988d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:36.778711 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:36.778491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:36.778877 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.778624 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:36.778877 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.778876 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret podName:26e0676b-b698-4df9-95a3-0073b021ce55 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:08.778852859 +0000 UTC m=+67.955246966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret") pod "global-pull-secret-syncer-scddx" (UID: "26e0676b-b698-4df9-95a3-0073b021ce55") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:36.879967 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:36.879934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:36.880119 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.880070 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:36.880119 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.880088 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:36.880119 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.880098 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hz5tl for pod openshift-network-diagnostics/network-check-target-48pl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:36.880269 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:36.880141 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl podName:a131a629-0149-4409-b083-a4dd34ea74d4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:08.880129628 +0000 UTC m=+68.056523710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz5tl" (UniqueName: "kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl") pod "network-check-target-48pl7" (UID: "a131a629-0149-4409-b083-a4dd34ea74d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:37.151031 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.151001 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-90.ec2.internal" event="NodeReady" Sep 17 17:34:37.151498 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.151151 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 17:34:37.202519 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.202488 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h5gsc"] Sep 17 17:34:37.225182 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.225154 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ms5dq"] Sep 17 17:34:37.225345 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.225285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.227618 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.227597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 17:34:37.227758 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.227634 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bd5nq\"" Sep 17 17:34:37.227758 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.227600 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 17:34:37.253166 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.253142 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h5gsc"] Sep 17 17:34:37.253279 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.253174 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ms5dq"] Sep 17 17:34:37.253279 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.253264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.255317 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.255296 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 17:34:37.255438 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.255317 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 17:34:37.255438 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.255431 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hrfbx\"" Sep 17 17:34:37.255680 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.255666 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 17:34:37.383417 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.383371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/860fa8b0-d877-4314-b97e-97eb26ee337b-tmp-dir\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.383660 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.383425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3-cert\") pod \"ingress-canary-ms5dq\" (UID: \"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3\") " pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.383660 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.383481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.383660 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.383629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgg8x\" (UniqueName: \"kubernetes.io/projected/d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3-kube-api-access-rgg8x\") pod \"ingress-canary-ms5dq\" (UID: \"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3\") " pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.383660 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.383659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/860fa8b0-d877-4314-b97e-97eb26ee337b-config-volume\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.383824 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.383680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnmcv\" (UniqueName: \"kubernetes.io/projected/860fa8b0-d877-4314-b97e-97eb26ee337b-kube-api-access-gnmcv\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.484760 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.484703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/860fa8b0-d877-4314-b97e-97eb26ee337b-tmp-dir\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.484760 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.484730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3-cert\") pod \"ingress-canary-ms5dq\" (UID: \"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3\") " pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.484760 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.484756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.484983 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.484773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgg8x\" (UniqueName: \"kubernetes.io/projected/d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3-kube-api-access-rgg8x\") pod \"ingress-canary-ms5dq\" (UID: \"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3\") " pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.484983 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.484840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/860fa8b0-d877-4314-b97e-97eb26ee337b-config-volume\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.484983 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:37.484925 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:37.484983 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:37.484971 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls podName:860fa8b0-d877-4314-b97e-97eb26ee337b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:37.984957476 +0000 UTC m=+37.161351559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls") pod "dns-default-h5gsc" (UID: "860fa8b0-d877-4314-b97e-97eb26ee337b") : secret "dns-default-metrics-tls" not found Sep 17 17:34:37.485153 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.484988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/860fa8b0-d877-4314-b97e-97eb26ee337b-tmp-dir\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.485153 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.485092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnmcv\" (UniqueName: \"kubernetes.io/projected/860fa8b0-d877-4314-b97e-97eb26ee337b-kube-api-access-gnmcv\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.485279 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.485260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/860fa8b0-d877-4314-b97e-97eb26ee337b-config-volume\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.488780 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.488757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3-cert\") pod \"ingress-canary-ms5dq\" (UID: \"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3\") " pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.498957 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.498932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnmcv\" (UniqueName: \"kubernetes.io/projected/860fa8b0-d877-4314-b97e-97eb26ee337b-kube-api-access-gnmcv\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.499034 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.498981 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgg8x\" (UniqueName: \"kubernetes.io/projected/d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3-kube-api-access-rgg8x\") pod \"ingress-canary-ms5dq\" (UID: \"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3\") " pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.563102 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.563083 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ms5dq" Sep 17 17:34:37.988803 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:37.988779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:37.988978 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:37.988954 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:37.989042 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:37.989033 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls podName:860fa8b0-d877-4314-b97e-97eb26ee337b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:38.989014105 +0000 UTC m=+38.165408192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls") pod "dns-default-h5gsc" (UID: "860fa8b0-d877-4314-b97e-97eb26ee337b") : secret "dns-default-metrics-tls" not found Sep 17 17:34:38.047929 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.047907 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ms5dq"] Sep 17 17:34:38.051476 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:38.051453 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a9bd5d_4cbd_48ac_aa75_1d94b099a0f3.slice/crio-3644b97f1d2e01ca5161fd0b18ddd67faf97a27be4b3753bb1ca9e2c13021998 WatchSource:0}: Error finding container 3644b97f1d2e01ca5161fd0b18ddd67faf97a27be4b3753bb1ca9e2c13021998: Status 404 returned error can't find the container with id 3644b97f1d2e01ca5161fd0b18ddd67faf97a27be4b3753bb1ca9e2c13021998 Sep 17 17:34:38.078035 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.078012 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:34:38.078035 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.078028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:34:38.078147 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.078037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:34:38.081043 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.081025 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:34:38.081136 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.081088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qcgkp\"" Sep 17 17:34:38.081136 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.081096 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:34:38.081136 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.081106 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:34:38.081272 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.081025 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crvff\"" Sep 17 17:34:38.081272 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.081024 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:34:38.346557 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.346492 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5" containerID="dcebde35b85e940de4b1eaff473b412655e907527e3f62e613d2f4059fc9d2a9" exitCode=0 Sep 17 17:34:38.347244 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.346566 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerDied","Data":"dcebde35b85e940de4b1eaff473b412655e907527e3f62e613d2f4059fc9d2a9"} Sep 17 17:34:38.347727 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.347711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ms5dq" event={"ID":"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3","Type":"ContainerStarted","Data":"3644b97f1d2e01ca5161fd0b18ddd67faf97a27be4b3753bb1ca9e2c13021998"} Sep 17 17:34:38.995122 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:38.995088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:38.995296 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:38.995202 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:38.995296 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:38.995252 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls podName:860fa8b0-d877-4314-b97e-97eb26ee337b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:40.995239021 +0000 UTC m=+40.171633104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls") pod "dns-default-h5gsc" (UID: "860fa8b0-d877-4314-b97e-97eb26ee337b") : secret "dns-default-metrics-tls" not found Sep 17 17:34:39.354452 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:39.354250 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5" containerID="c30ebc2de9ba42721f9820dbcd668718eb43a3af29d67f548d40181db4a6da6a" exitCode=0 Sep 17 17:34:39.354452 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:39.354325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerDied","Data":"c30ebc2de9ba42721f9820dbcd668718eb43a3af29d67f548d40181db4a6da6a"} Sep 17 17:34:40.360058 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:40.360022 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" event={"ID":"bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5","Type":"ContainerStarted","Data":"342536433fff2e149958cffa84b77b84d5257fc45ca3a684bdb8a84932e41505"} Sep 17 17:34:40.361387 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:40.361361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ms5dq" event={"ID":"d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3","Type":"ContainerStarted","Data":"71e01606461e8c7b05208363efb4cbc7b87c6b82618e573cfffdccb3634f55d6"} Sep 17 17:34:40.382677 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:40.382642 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4kp9x" podStartSLOduration=10.197235994 podStartE2EDuration="37.382628853s" totalImagesPullingTime="27.185392859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:40.381565024 +0000 UTC m=+39.557959165" watchObservedRunningTime="2026-09-17 17:34:40.382628853 +0000 UTC m=+39.559022950" Sep 17 17:34:40.399702 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:40.399663 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ms5dq" podStartSLOduration=1.346928916 podStartE2EDuration="3.399651044s" totalImagesPullingTime="2.052722128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:40.399067313 +0000 UTC m=+39.575461420" watchObservedRunningTime="2026-09-17 17:34:40.399651044 +0000 UTC m=+39.576045148" Sep 17 17:34:41.012465 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:41.012426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:41.012599 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:41.012550 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:41.012632 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:41.012602 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls podName:860fa8b0-d877-4314-b97e-97eb26ee337b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:45.012588424 +0000 UTC m=+44.188982506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls") pod "dns-default-h5gsc" (UID: "860fa8b0-d877-4314-b97e-97eb26ee337b") : secret "dns-default-metrics-tls" not found Sep 17 17:34:45.039218 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.039175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:45.039615 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:45.039289 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:45.039615 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:45.039339 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls podName:860fa8b0-d877-4314-b97e-97eb26ee337b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:53.039326821 +0000 UTC m=+52.215720903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls") pod "dns-default-h5gsc" (UID: "860fa8b0-d877-4314-b97e-97eb26ee337b") : secret "dns-default-metrics-tls" not found Sep 17 17:34:45.774635 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.774603 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b"] Sep 17 17:34:45.776489 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.776470 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" Sep 17 17:34:45.778366 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.778341 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xt8qj"] Sep 17 17:34:45.778583 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.778564 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l9l76\"" Sep 17 17:34:45.778748 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.778728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:45.778835 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.778816 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:45.780115 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.780100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:45.782025 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.782005 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:45.782121 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.782013 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:45.782121 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.782038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 17 17:34:45.782121 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.782048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gnlrc\"" Sep 17 17:34:45.782423 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.782193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 17 17:34:45.789453 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.789432 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 17 17:34:45.794982 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.794959 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-599677c649-btcf6"] Sep 17 17:34:45.797049 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.797030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b"] Sep 17 17:34:45.797125 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.797062 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xt8qj"] Sep 17 17:34:45.797162 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.797122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.799677 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.799657 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 17:34:45.799788 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.799769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 17:34:45.799850 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.799805 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jxpgb\"" Sep 17 17:34:45.799938 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.799922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 17:34:45.806248 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.806232 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 17:34:45.816066 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.816046 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599677c649-btcf6"] Sep 17 17:34:45.946424 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-trusted-ca\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946538 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79pdb\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-kube-api-access-79pdb\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946538 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnk8v\" (UniqueName: \"kubernetes.io/projected/62568fdc-8cb9-488b-98e2-fc8ea0ce20fa-kube-api-access-rnk8v\") pod \"volume-data-source-validator-5c4db8bdf9-nv87b\" (UID: \"62568fdc-8cb9-488b-98e2-fc8ea0ce20fa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" Sep 17 17:34:45.946538 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f204dbc5-eb0f-4da4-b548-7529e2ea4675-serving-cert\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:45.946538 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f204dbc5-eb0f-4da4-b548-7529e2ea4675-trusted-ca\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3519099-f840-42c7-912d-8c7c29d282a2-ca-trust-extracted\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-image-registry-private-configuration\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tdgq\" (UniqueName: \"kubernetes.io/projected/f204dbc5-eb0f-4da4-b548-7529e2ea4675-kube-api-access-4tdgq\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946613 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-installation-pull-secrets\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946631 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-registry-certificates\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946658 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-bound-sa-token\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:45.946864 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.946661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f204dbc5-eb0f-4da4-b548-7529e2ea4675-config\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:45.972341 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.972317 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f"] Sep 17 17:34:45.974231 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.974216 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:45.976855 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.976832 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:45.976855 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.976850 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:45.976991 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.976877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 17:34:45.976991 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.976936 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9zzm8\"" Sep 17 17:34:45.989276 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:45.989257 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f"] Sep 17 17:34:46.047123 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f204dbc5-eb0f-4da4-b548-7529e2ea4675-trusted-ca\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3519099-f840-42c7-912d-8c7c29d282a2-ca-trust-extracted\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-image-registry-private-configuration\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tdgq\" (UniqueName: \"kubernetes.io/projected/f204dbc5-eb0f-4da4-b548-7529e2ea4675-kube-api-access-4tdgq\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-installation-pull-secrets\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-registry-certificates\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.047370 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-bound-sa-token\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.047469 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599677c649-btcf6: secret "image-registry-tls" not found Sep 17 17:34:46.047490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f204dbc5-eb0f-4da4-b548-7529e2ea4675-config\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-trusted-ca\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3519099-f840-42c7-912d-8c7c29d282a2-ca-trust-extracted\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.047570 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls podName:a3519099-f840-42c7-912d-8c7c29d282a2 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:46.547548428 +0000 UTC m=+45.723942525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls") pod "image-registry-599677c649-btcf6" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2") : secret "image-registry-tls" not found Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79pdb\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-kube-api-access-79pdb\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnk8v\" (UniqueName: \"kubernetes.io/projected/62568fdc-8cb9-488b-98e2-fc8ea0ce20fa-kube-api-access-rnk8v\") pod \"volume-data-source-validator-5c4db8bdf9-nv87b\" (UID: \"62568fdc-8cb9-488b-98e2-fc8ea0ce20fa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f204dbc5-eb0f-4da4-b548-7529e2ea4675-serving-cert\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.047993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.047841 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-registry-certificates\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.048333 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.048016 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f204dbc5-eb0f-4da4-b548-7529e2ea4675-trusted-ca\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.048390 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.048363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f204dbc5-eb0f-4da4-b548-7529e2ea4675-config\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.048896 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.048877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-trusted-ca\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.050640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.050622 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f204dbc5-eb0f-4da4-b548-7529e2ea4675-serving-cert\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.050716 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.050671 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-image-registry-private-configuration\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.050754 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.050718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-installation-pull-secrets\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.059032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.059002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-bound-sa-token\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.059150 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.059133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnk8v\" (UniqueName: \"kubernetes.io/projected/62568fdc-8cb9-488b-98e2-fc8ea0ce20fa-kube-api-access-rnk8v\") pod \"volume-data-source-validator-5c4db8bdf9-nv87b\" (UID: \"62568fdc-8cb9-488b-98e2-fc8ea0ce20fa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" Sep 17 17:34:46.059918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.059894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79pdb\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-kube-api-access-79pdb\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.060149 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.060135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tdgq\" (UniqueName: \"kubernetes.io/projected/f204dbc5-eb0f-4da4-b548-7529e2ea4675-kube-api-access-4tdgq\") pod \"console-operator-fd4bb46c-xt8qj\" (UID: \"f204dbc5-eb0f-4da4-b548-7529e2ea4675\") " pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.087084 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.087065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" Sep 17 17:34:46.092804 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.092787 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:46.148889 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.148864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq6t\" (UniqueName: \"kubernetes.io/projected/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-kube-api-access-pwq6t\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:46.148974 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.148965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:46.250127 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.250092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:46.250127 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.250135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq6t\" (UniqueName: \"kubernetes.io/projected/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-kube-api-access-pwq6t\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:46.250309 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.250246 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:34:46.250360 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.250320 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls podName:9bc46273-a66e-4ff1-8dfb-0db082bcd9e3 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:46.750305693 +0000 UTC m=+45.926699776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2cg2f" (UID: "9bc46273-a66e-4ff1-8dfb-0db082bcd9e3") : secret "samples-operator-tls" not found Sep 17 17:34:46.259560 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.259539 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq6t\" (UniqueName: \"kubernetes.io/projected/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-kube-api-access-pwq6t\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:46.353060 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.352995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b"] Sep 17 17:34:46.355700 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:46.355675 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62568fdc_8cb9_488b_98e2_fc8ea0ce20fa.slice/crio-83dd47a7e81a6bf2ab5bf72a895140fe243da92ee8674d3ee685c2c7d835b3e7 WatchSource:0}: Error finding container 83dd47a7e81a6bf2ab5bf72a895140fe243da92ee8674d3ee685c2c7d835b3e7: Status 404 returned error can't find the container with id 83dd47a7e81a6bf2ab5bf72a895140fe243da92ee8674d3ee685c2c7d835b3e7 Sep 17 17:34:46.359418 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.359375 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xt8qj"] Sep 17 17:34:46.363570 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:46.363547 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf204dbc5_eb0f_4da4_b548_7529e2ea4675.slice/crio-666f499c11a2d618a3e9149d715e545c20e3358b65e70e2b7045fe4cf204be2a WatchSource:0}: Error finding container 666f499c11a2d618a3e9149d715e545c20e3358b65e70e2b7045fe4cf204be2a: Status 404 returned error can't find the container with id 666f499c11a2d618a3e9149d715e545c20e3358b65e70e2b7045fe4cf204be2a Sep 17 17:34:46.375751 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.375729 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" event={"ID":"f204dbc5-eb0f-4da4-b548-7529e2ea4675","Type":"ContainerStarted","Data":"666f499c11a2d618a3e9149d715e545c20e3358b65e70e2b7045fe4cf204be2a"} Sep 17 17:34:46.376687 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.376662 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" event={"ID":"62568fdc-8cb9-488b-98e2-fc8ea0ce20fa","Type":"ContainerStarted","Data":"83dd47a7e81a6bf2ab5bf72a895140fe243da92ee8674d3ee685c2c7d835b3e7"} Sep 17 17:34:46.552848 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.552821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:46.552959 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.552929 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:46.552959 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.552938 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599677c649-btcf6: secret "image-registry-tls" not found Sep 17 17:34:46.553030 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.552993 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls podName:a3519099-f840-42c7-912d-8c7c29d282a2 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:47.552980869 +0000 UTC m=+46.729374951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls") pod "image-registry-599677c649-btcf6" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2") : secret "image-registry-tls" not found Sep 17 17:34:46.754084 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:46.754017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:46.754201 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.754184 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:34:46.754278 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:46.754264 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls podName:9bc46273-a66e-4ff1-8dfb-0db082bcd9e3 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:47.754245252 +0000 UTC m=+46.930639350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2cg2f" (UID: "9bc46273-a66e-4ff1-8dfb-0db082bcd9e3") : secret "samples-operator-tls" not found Sep 17 17:34:47.381362 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:47.381329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" event={"ID":"62568fdc-8cb9-488b-98e2-fc8ea0ce20fa","Type":"ContainerStarted","Data":"fe85e9576d92aa19d821376097110a5eb793baf2b07f71193141031f5ace1876"} Sep 17 17:34:47.408029 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:47.407985 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-nv87b" podStartSLOduration=1.4465800340000001 podStartE2EDuration="2.407971024s" totalImagesPullingTime="961.39099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:47.407586121 +0000 UTC m=+46.583980250" watchObservedRunningTime="2026-09-17 17:34:47.407971024 +0000 UTC m=+46.584365129" Sep 17 17:34:47.560987 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:47.560952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:47.561135 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:47.561084 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:47.561135 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:47.561102 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599677c649-btcf6: secret "image-registry-tls" not found Sep 17 17:34:47.561224 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:47.561152 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls podName:a3519099-f840-42c7-912d-8c7c29d282a2 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.5611376 +0000 UTC m=+48.737531687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls") pod "image-registry-599677c649-btcf6" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2") : secret "image-registry-tls" not found Sep 17 17:34:47.762435 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:47.762350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:47.762588 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:47.762494 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:34:47.762588 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:47.762563 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls podName:9bc46273-a66e-4ff1-8dfb-0db082bcd9e3 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.762544583 +0000 UTC m=+48.938938665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2cg2f" (UID: "9bc46273-a66e-4ff1-8dfb-0db082bcd9e3") : secret "samples-operator-tls" not found Sep 17 17:34:48.385601 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:48.385534 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/0.log" Sep 17 17:34:48.385601 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:48.385569 2580 generic.go:356] "Generic (PLEG): container finished" podID="f204dbc5-eb0f-4da4-b548-7529e2ea4675" containerID="eb825dbfcb691136da6c8b31b192120a4063feb9a7cac4b47a22affecba439c0" exitCode=255 Sep 17 17:34:48.385945 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:48.385632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" event={"ID":"f204dbc5-eb0f-4da4-b548-7529e2ea4675","Type":"ContainerDied","Data":"eb825dbfcb691136da6c8b31b192120a4063feb9a7cac4b47a22affecba439c0"} Sep 17 17:34:48.385945 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:48.385792 2580 scope.go:117] "RemoveContainer" containerID="eb825dbfcb691136da6c8b31b192120a4063feb9a7cac4b47a22affecba439c0" Sep 17 17:34:49.389312 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.389287 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:34:49.389666 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.389655 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/0.log" Sep 17 17:34:49.389717 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.389688 2580 generic.go:356] "Generic (PLEG): container finished" podID="f204dbc5-eb0f-4da4-b548-7529e2ea4675" containerID="4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f" exitCode=255 Sep 17 17:34:49.389772 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.389749 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" event={"ID":"f204dbc5-eb0f-4da4-b548-7529e2ea4675","Type":"ContainerDied","Data":"4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f"} Sep 17 17:34:49.389865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.389806 2580 scope.go:117] "RemoveContainer" containerID="eb825dbfcb691136da6c8b31b192120a4063feb9a7cac4b47a22affecba439c0" Sep 17 17:34:49.389985 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.389970 2580 scope.go:117] "RemoveContainer" containerID="4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f" Sep 17 17:34:49.390147 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:49.390126 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xt8qj_openshift-console-operator(f204dbc5-eb0f-4da4-b548-7529e2ea4675)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" podUID="f204dbc5-eb0f-4da4-b548-7529e2ea4675" Sep 17 17:34:49.574644 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.574619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:49.574758 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:49.574738 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:49.574838 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:49.574761 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599677c649-btcf6: secret "image-registry-tls" not found Sep 17 17:34:49.574838 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:49.574827 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls podName:a3519099-f840-42c7-912d-8c7c29d282a2 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:53.574806875 +0000 UTC m=+52.751200957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls") pod "image-registry-599677c649-btcf6" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2") : secret "image-registry-tls" not found Sep 17 17:34:49.776226 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:49.776165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:49.776307 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:49.776285 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:34:49.776345 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:49.776329 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls podName:9bc46273-a66e-4ff1-8dfb-0db082bcd9e3 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:53.776317271 +0000 UTC m=+52.952711353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2cg2f" (UID: "9bc46273-a66e-4ff1-8dfb-0db082bcd9e3") : secret "samples-operator-tls" not found Sep 17 17:34:50.393186 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:50.393158 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:34:50.393566 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:50.393485 2580 scope.go:117] "RemoveContainer" containerID="4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f" Sep 17 17:34:50.393632 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:50.393614 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xt8qj_openshift-console-operator(f204dbc5-eb0f-4da4-b548-7529e2ea4675)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" podUID="f204dbc5-eb0f-4da4-b548-7529e2ea4675" Sep 17 17:34:52.815914 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.815861 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bldj9"] Sep 17 17:34:52.836219 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.836197 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bldj9"] Sep 17 17:34:52.836348 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.836321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.838479 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.838455 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 17:34:52.838479 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.838460 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 17:34:52.838479 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.838458 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 17:34:52.838691 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.838461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7fflr\"" Sep 17 17:34:52.839196 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.839181 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 17:34:52.896559 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.896535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2mw\" (UniqueName: \"kubernetes.io/projected/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-api-access-nq2mw\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.896675 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.896589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab6443fa-e410-40c4-9b6e-b23609af2fc4-crio-socket\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.896675 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.896624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6443fa-e410-40c4-9b6e-b23609af2fc4-data-volume\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.896675 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.896639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.896782 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.896694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.997840 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.997811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.997983 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.997877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2mw\" (UniqueName: \"kubernetes.io/projected/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-api-access-nq2mw\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.997983 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:52.997928 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:34:52.998056 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:52.998004 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:53.497986094 +0000 UTC m=+52.674380193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : configmap "kube-rbac-proxy" not found Sep 17 17:34:52.998096 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.998052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab6443fa-e410-40c4-9b6e-b23609af2fc4-crio-socket\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.998096 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.998081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6443fa-e410-40c4-9b6e-b23609af2fc4-data-volume\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.998158 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.998104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.998236 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:52.998223 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:34:52.998281 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.998259 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab6443fa-e410-40c4-9b6e-b23609af2fc4-crio-socket\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:52.998316 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:52.998269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:53.498254887 +0000 UTC m=+52.674648970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : secret "insights-runtime-extractor-tls" not found Sep 17 17:34:52.998388 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:52.998375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6443fa-e410-40c4-9b6e-b23609af2fc4-data-volume\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:53.010770 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:53.010741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2mw\" (UniqueName: \"kubernetes.io/projected/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-api-access-nq2mw\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:53.098428 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:53.098354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:34:53.098557 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.098497 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:53.098557 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.098550 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls podName:860fa8b0-d877-4314-b97e-97eb26ee337b nodeName:}" failed. No retries permitted until 2026-09-17 17:35:09.0985366 +0000 UTC m=+68.274930687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls") pod "dns-default-h5gsc" (UID: "860fa8b0-d877-4314-b97e-97eb26ee337b") : secret "dns-default-metrics-tls" not found Sep 17 17:34:53.500975 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:53.500899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:53.500975 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:53.500953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:53.501211 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.501053 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:34:53.501211 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.501127 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:54.501111525 +0000 UTC m=+53.677505608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : secret "insights-runtime-extractor-tls" not found Sep 17 17:34:53.501211 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.501058 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:34:53.501211 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.501176 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:54.501165348 +0000 UTC m=+53.677559430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : configmap "kube-rbac-proxy" not found Sep 17 17:34:53.601759 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:53.601730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:34:53.601893 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.601879 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:53.601932 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.601895 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599677c649-btcf6: secret "image-registry-tls" not found Sep 17 17:34:53.601964 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.601942 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls podName:a3519099-f840-42c7-912d-8c7c29d282a2 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:01.601928407 +0000 UTC m=+60.778322495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls") pod "image-registry-599677c649-btcf6" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2") : secret "image-registry-tls" not found Sep 17 17:34:53.803406 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:53.803378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:34:53.803544 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.803517 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:34:53.803589 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:53.803579 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls podName:9bc46273-a66e-4ff1-8dfb-0db082bcd9e3 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:01.803564257 +0000 UTC m=+60.979958339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2cg2f" (UID: "9bc46273-a66e-4ff1-8dfb-0db082bcd9e3") : secret "samples-operator-tls" not found Sep 17 17:34:54.419342 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.419312 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd"] Sep 17 17:34:54.453166 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.453138 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd"] Sep 17 17:34:54.453308 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.453225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.455497 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.455473 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 17:34:54.455627 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.455532 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 17:34:54.455627 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.455532 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 17:34:54.455627 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.455574 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 17:34:54.509464 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.509442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d6cc929-7170-4189-9591-98c777bf66f1-tmp\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.509582 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.509496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7gn\" (UniqueName: \"kubernetes.io/projected/0d6cc929-7170-4189-9591-98c777bf66f1-kube-api-access-7f7gn\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.509582 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.509526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0d6cc929-7170-4189-9591-98c777bf66f1-klusterlet-config\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.509659 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.509590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:54.509659 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.509608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:54.509724 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:54.509666 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:34:54.509724 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:54.509670 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:34:54.509724 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:54.509716 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:56.509703706 +0000 UTC m=+55.686097788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : configmap "kube-rbac-proxy" not found Sep 17 17:34:54.509814 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:54.509727 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:56.509722156 +0000 UTC m=+55.686116239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : secret "insights-runtime-extractor-tls" not found Sep 17 17:34:54.609840 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.609813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d6cc929-7170-4189-9591-98c777bf66f1-tmp\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.609944 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.609864 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7gn\" (UniqueName: \"kubernetes.io/projected/0d6cc929-7170-4189-9591-98c777bf66f1-kube-api-access-7f7gn\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.610018 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.610001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0d6cc929-7170-4189-9591-98c777bf66f1-klusterlet-config\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.610206 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.610187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d6cc929-7170-4189-9591-98c777bf66f1-tmp\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.612256 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.612239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0d6cc929-7170-4189-9591-98c777bf66f1-klusterlet-config\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.620335 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.620316 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7gn\" (UniqueName: \"kubernetes.io/projected/0d6cc929-7170-4189-9591-98c777bf66f1-kube-api-access-7f7gn\") pod \"klusterlet-addon-workmgr-577449cd9f-mjwcd\" (UID: \"0d6cc929-7170-4189-9591-98c777bf66f1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.761798 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.761750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:34:54.818377 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.818341 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bcmt9"] Sep 17 17:34:54.832944 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.832924 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bcmt9"] Sep 17 17:34:54.833051 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.833004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:54.835526 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.835489 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 17:34:54.835651 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.835538 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 17:34:54.835651 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.835543 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 17:34:54.835651 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.835538 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 17:34:54.835651 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.835571 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lqx8g\"" Sep 17 17:34:54.912007 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.911973 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-signing-key\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:54.912118 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.912032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-signing-cabundle\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:54.912118 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:54.912048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9lx\" (UniqueName: \"kubernetes.io/projected/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-kube-api-access-xj9lx\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.013114 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.013070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-signing-key\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.013186 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.013114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-signing-cabundle\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.013186 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.013132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9lx\" (UniqueName: \"kubernetes.io/projected/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-kube-api-access-xj9lx\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.013746 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.013730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-signing-cabundle\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.015283 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.015267 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-signing-key\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.027393 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.027375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9lx\" (UniqueName: \"kubernetes.io/projected/8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d-kube-api-access-xj9lx\") pod \"service-ca-55f6fc7b86-bcmt9\" (UID: \"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.034264 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.034246 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd"] Sep 17 17:34:55.037588 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:55.037567 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6cc929_7170_4189_9591_98c777bf66f1.slice/crio-a2b46676a2f088adcb7c81d35e4619f2f3af23694b2986872ad1d0e852157eb3 WatchSource:0}: Error finding container a2b46676a2f088adcb7c81d35e4619f2f3af23694b2986872ad1d0e852157eb3: Status 404 returned error can't find the container with id a2b46676a2f088adcb7c81d35e4619f2f3af23694b2986872ad1d0e852157eb3 Sep 17 17:34:55.141847 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.141827 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" Sep 17 17:34:55.405775 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.405734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" event={"ID":"0d6cc929-7170-4189-9591-98c777bf66f1","Type":"ContainerStarted","Data":"a2b46676a2f088adcb7c81d35e4619f2f3af23694b2986872ad1d0e852157eb3"} Sep 17 17:34:55.420072 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.419318 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bcmt9"] Sep 17 17:34:55.424173 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:34:55.424150 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eca2afa_97bb_4a91_a5d5_73fc5caf6f8d.slice/crio-e0ff15c01bbf31e3dae2bc16ce9dd2de33670b5dce81a78a9a2e1e2c1e1bbda1 WatchSource:0}: Error finding container e0ff15c01bbf31e3dae2bc16ce9dd2de33670b5dce81a78a9a2e1e2c1e1bbda1: Status 404 returned error can't find the container with id e0ff15c01bbf31e3dae2bc16ce9dd2de33670b5dce81a78a9a2e1e2c1e1bbda1 Sep 17 17:34:55.567106 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:55.567082 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m6zw8_99c43776-aa7e-485b-9b2a-32e2acca7601/dns-node-resolver/0.log" Sep 17 17:34:56.094475 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.093601 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:56.094475 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.094057 2580 scope.go:117] "RemoveContainer" containerID="4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f" Sep 17 17:34:56.094475 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:56.094278 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xt8qj_openshift-console-operator(f204dbc5-eb0f-4da4-b548-7529e2ea4675)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" podUID="f204dbc5-eb0f-4da4-b548-7529e2ea4675" Sep 17 17:34:56.094475 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.094409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:34:56.410162 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.410068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" event={"ID":"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d","Type":"ContainerStarted","Data":"e0ff15c01bbf31e3dae2bc16ce9dd2de33670b5dce81a78a9a2e1e2c1e1bbda1"} Sep 17 17:34:56.410373 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.410350 2580 scope.go:117] "RemoveContainer" containerID="4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f" Sep 17 17:34:56.410563 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:56.410539 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xt8qj_openshift-console-operator(f204dbc5-eb0f-4da4-b548-7529e2ea4675)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" podUID="f204dbc5-eb0f-4da4-b548-7529e2ea4675" Sep 17 17:34:56.525258 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.525222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:56.525712 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.525290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:34:56.525712 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:56.525442 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:34:56.525712 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:56.525468 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:34:56.525712 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:56.525506 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:00.525488198 +0000 UTC m=+59.701882294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : configmap "kube-rbac-proxy" not found Sep 17 17:34:56.525712 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:34:56.525530 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:00.525512306 +0000 UTC m=+59.701906414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : secret "insights-runtime-extractor-tls" not found Sep 17 17:34:56.566167 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:56.566140 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8sj6_af388933-e192-4d07-82db-3a014715264b/node-ca/0.log" Sep 17 17:34:57.365059 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:57.365019 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ms5dq_d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3/serve-healthcheck-canary/0.log" Sep 17 17:34:59.420417 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:59.420364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" event={"ID":"8eca2afa-97bb-4a91-a5d5-73fc5caf6f8d","Type":"ContainerStarted","Data":"8f31fa6c80534699adb79c8ad9b20d18f98db773a6c1e873e3edcffe16c69aa9"} Sep 17 17:34:59.439741 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:34:59.439675 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-bcmt9" podStartSLOduration=2.5133853139999998 podStartE2EDuration="5.439655648s" totalImagesPullingTime="2.926270334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:59.438880601 +0000 UTC m=+58.615274705" watchObservedRunningTime="2026-09-17 17:34:59.439655648 +0000 UTC m=+58.616049753" Sep 17 17:35:00.425942 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:00.425909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" event={"ID":"0d6cc929-7170-4189-9591-98c777bf66f1","Type":"ContainerStarted","Data":"50a5b3eb6d0024531adf4a7c12dbad93f3d2051709cbbe40424f5ed59c382614"} Sep 17 17:35:00.444974 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:00.444936 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" podStartSLOduration=1.196042254 podStartE2EDuration="6.444922057s" totalImagesPullingTime="5.248879803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:00.443925042 +0000 UTC m=+59.620319161" watchObservedRunningTime="2026-09-17 17:35:00.444922057 +0000 UTC m=+59.621316161" Sep 17 17:35:00.563344 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:00.563282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:00.563344 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:00.563316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:00.563542 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:00.563440 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:35:00.563542 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:00.563511 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:08.563491637 +0000 UTC m=+67.739885731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : secret "insights-runtime-extractor-tls" not found Sep 17 17:35:00.563542 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:00.563448 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:35:00.563694 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:00.563579 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:08.563566319 +0000 UTC m=+67.739960403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : configmap "kube-rbac-proxy" not found Sep 17 17:35:01.344279 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.344253 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncbx8" Sep 17 17:35:01.428714 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.428683 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:35:01.430298 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.430277 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577449cd9f-mjwcd" Sep 17 17:35:01.672564 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.672500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:01.672686 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:01.672631 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:35:01.672686 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:01.672642 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599677c649-btcf6: secret "image-registry-tls" not found Sep 17 17:35:01.672791 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:01.672690 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls podName:a3519099-f840-42c7-912d-8c7c29d282a2 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:17.672677857 +0000 UTC m=+76.849071939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls") pod "image-registry-599677c649-btcf6" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2") : secret "image-registry-tls" not found Sep 17 17:35:01.873810 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.873774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:35:01.876089 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.876060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bc46273-a66e-4ff1-8dfb-0db082bcd9e3-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2cg2f\" (UID: \"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:35:01.881892 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:01.881877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" Sep 17 17:35:02.164291 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:02.164260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f"] Sep 17 17:35:02.437828 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:02.437791 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" event={"ID":"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3","Type":"ContainerStarted","Data":"7f62843292863897c3519c7cbc7d1d2449b89b1095913486e6df13d4ed581703"} Sep 17 17:35:04.452615 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:04.452533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" event={"ID":"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3","Type":"ContainerStarted","Data":"8bf32dee6303f7cd0240a13f785b74d7a3183753cb018c360b151ba6169151c5"} Sep 17 17:35:04.453171 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:04.453148 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" event={"ID":"9bc46273-a66e-4ff1-8dfb-0db082bcd9e3","Type":"ContainerStarted","Data":"a3b1944a0366f11ca7f38e1c69e13aea86bcad103a0d1d839fccd66e26883887"} Sep 17 17:35:04.469938 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:04.469748 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2cg2f" podStartSLOduration=17.614190621 podStartE2EDuration="19.469732901s" totalImagesPullingTime="1.85554228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:04.468753398 +0000 UTC m=+63.645147500" watchObservedRunningTime="2026-09-17 17:35:04.469732901 +0000 UTC m=+63.646127004" Sep 17 17:35:07.077869 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:07.077841 2580 scope.go:117] "RemoveContainer" containerID="4aa053e71eedb936c8259580b2ea40903ddf53f1109370e113237b052a1d089f" Sep 17 17:35:07.464560 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:07.464488 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:35:07.464560 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:07.464553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" event={"ID":"f204dbc5-eb0f-4da4-b548-7529e2ea4675","Type":"ContainerStarted","Data":"70277ac101697e5d6a3988341cf53f3ff6cf76342e61085dc27cb48c5e186a10"} Sep 17 17:35:07.464915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:07.464895 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:35:07.483132 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:07.483091 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" podStartSLOduration=20.789461426 podStartE2EDuration="22.483079419s" totalImagesPullingTime="1.693617993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:07.48230916 +0000 UTC m=+66.658703275" watchObservedRunningTime="2026-09-17 17:35:07.483079419 +0000 UTC m=+66.659473522" Sep 17 17:35:08.266817 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.266787 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-xt8qj" Sep 17 17:35:08.632287 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.632254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:08.632287 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.632288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:08.632556 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:08.632426 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:35:08.632556 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:08.632494 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls podName:ab6443fa-e410-40c4-9b6e-b23609af2fc4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:24.632475689 +0000 UTC m=+83.808869785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bldj9" (UID: "ab6443fa-e410-40c4-9b6e-b23609af2fc4") : secret "insights-runtime-extractor-tls" not found Sep 17 17:35:08.632719 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.632702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab6443fa-e410-40c4-9b6e-b23609af2fc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:08.733073 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.733046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:35:08.735872 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.735856 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:35:08.745707 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.745687 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d8eadcd-005e-4f1f-91c0-076b0498988d-metrics-certs\") pod \"network-metrics-daemon-76whh\" (UID: \"2d8eadcd-005e-4f1f-91c0-076b0498988d\") " pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:35:08.834438 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.834409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:35:08.836674 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.836655 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:35:08.847370 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.847354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e0676b-b698-4df9-95a3-0073b021ce55-original-pull-secret\") pod \"global-pull-secret-syncer-scddx\" (UID: \"26e0676b-b698-4df9-95a3-0073b021ce55\") " pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:35:08.935247 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.935181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:35:08.937330 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.937311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:35:08.947369 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.947354 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:35:08.958231 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.958211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz5tl\" (UniqueName: \"kubernetes.io/projected/a131a629-0149-4409-b083-a4dd34ea74d4-kube-api-access-hz5tl\") pod \"network-check-target-48pl7\" (UID: \"a131a629-0149-4409-b083-a4dd34ea74d4\") " pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:35:08.989973 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.989955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crvff\"" Sep 17 17:35:08.994426 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.994411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qcgkp\"" Sep 17 17:35:08.997503 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.997488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scddx" Sep 17 17:35:08.998566 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:08.998549 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:35:09.003694 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.003668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76whh" Sep 17 17:35:09.137115 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.137085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:35:09.139135 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.139111 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/860fa8b0-d877-4314-b97e-97eb26ee337b-metrics-tls\") pod \"dns-default-h5gsc\" (UID: \"860fa8b0-d877-4314-b97e-97eb26ee337b\") " pod="openshift-dns/dns-default-h5gsc" Sep 17 17:35:09.277491 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.277382 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48pl7"] Sep 17 17:35:09.280028 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.279966 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-scddx"] Sep 17 17:35:09.281027 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.281006 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-76whh"] Sep 17 17:35:09.281727 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:09.281706 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda131a629_0149_4409_b083_a4dd34ea74d4.slice/crio-8d63802bcb77abdd0e540266b4b84110a134d9b6a9384246a62860c10c9fae6c WatchSource:0}: Error finding container 8d63802bcb77abdd0e540266b4b84110a134d9b6a9384246a62860c10c9fae6c: Status 404 returned error can't find the container with id 8d63802bcb77abdd0e540266b4b84110a134d9b6a9384246a62860c10c9fae6c Sep 17 17:35:09.284232 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:09.283731 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8eadcd_005e_4f1f_91c0_076b0498988d.slice/crio-4f2540f4e78ad52f109dc002dcd5dea7e71b2f23d7de8ee7724dd2e41ca785f8 WatchSource:0}: Error finding container 4f2540f4e78ad52f109dc002dcd5dea7e71b2f23d7de8ee7724dd2e41ca785f8: Status 404 returned error can't find the container with id 4f2540f4e78ad52f109dc002dcd5dea7e71b2f23d7de8ee7724dd2e41ca785f8 Sep 17 17:35:09.284899 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:09.284878 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e0676b_b698_4df9_95a3_0073b021ce55.slice/crio-fde7776f04714c68f7a8f5af7bcfb064bdc994a5d3f1758367f8546791790824 WatchSource:0}: Error finding container fde7776f04714c68f7a8f5af7bcfb064bdc994a5d3f1758367f8546791790824: Status 404 returned error can't find the container with id fde7776f04714c68f7a8f5af7bcfb064bdc994a5d3f1758367f8546791790824 Sep 17 17:35:09.338415 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.338374 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bd5nq\"" Sep 17 17:35:09.347171 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.347155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h5gsc" Sep 17 17:35:09.475287 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.475249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-scddx" event={"ID":"26e0676b-b698-4df9-95a3-0073b021ce55","Type":"ContainerStarted","Data":"fde7776f04714c68f7a8f5af7bcfb064bdc994a5d3f1758367f8546791790824"} Sep 17 17:35:09.476257 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.476234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76whh" event={"ID":"2d8eadcd-005e-4f1f-91c0-076b0498988d","Type":"ContainerStarted","Data":"4f2540f4e78ad52f109dc002dcd5dea7e71b2f23d7de8ee7724dd2e41ca785f8"} Sep 17 17:35:09.477273 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.477252 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48pl7" event={"ID":"a131a629-0149-4409-b083-a4dd34ea74d4","Type":"ContainerStarted","Data":"8d63802bcb77abdd0e540266b4b84110a134d9b6a9384246a62860c10c9fae6c"} Sep 17 17:35:09.625299 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:09.625272 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h5gsc"] Sep 17 17:35:09.628311 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:09.628286 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860fa8b0_d877_4314_b97e_97eb26ee337b.slice/crio-11d111fac2e8c7d63781351fb74a7786fafbd5731492a1a24da1dd812a098c1f WatchSource:0}: Error finding container 11d111fac2e8c7d63781351fb74a7786fafbd5731492a1a24da1dd812a098c1f: Status 404 returned error can't find the container with id 11d111fac2e8c7d63781351fb74a7786fafbd5731492a1a24da1dd812a098c1f Sep 17 17:35:10.488458 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:10.488194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h5gsc" event={"ID":"860fa8b0-d877-4314-b97e-97eb26ee337b","Type":"ContainerStarted","Data":"11d111fac2e8c7d63781351fb74a7786fafbd5731492a1a24da1dd812a098c1f"} Sep 17 17:35:10.492258 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:10.491488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76whh" event={"ID":"2d8eadcd-005e-4f1f-91c0-076b0498988d","Type":"ContainerStarted","Data":"c8e6b68c646086dcc2dcb099df507f40585d7a9faf35cd8445ef3c073ccc3477"} Sep 17 17:35:10.492258 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:10.491540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76whh" event={"ID":"2d8eadcd-005e-4f1f-91c0-076b0498988d","Type":"ContainerStarted","Data":"ddbb87a6238919fa7594123abb007488bcb2b7e5b895affb3582ecdd38fc6bf8"} Sep 17 17:35:10.514529 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:10.514022 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-76whh" podStartSLOduration=66.581114182 podStartE2EDuration="1m7.514004279s" totalImagesPullingTime="932.890097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:10.512943654 +0000 UTC m=+69.689337759" watchObservedRunningTime="2026-09-17 17:35:10.514004279 +0000 UTC m=+69.690398384" Sep 17 17:35:14.507026 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.506935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-scddx" event={"ID":"26e0676b-b698-4df9-95a3-0073b021ce55","Type":"ContainerStarted","Data":"6ebd1ef870c8a565fa58bb7036ed6c7b26c7432a30845d36691764b6e18dd3a1"} Sep 17 17:35:14.508753 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.508729 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h5gsc" event={"ID":"860fa8b0-d877-4314-b97e-97eb26ee337b","Type":"ContainerStarted","Data":"f2f0f675f700a36e942682c5d22970b9efbeb03fd3ccfe9fc911f0848151c593"} Sep 17 17:35:14.508894 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.508769 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h5gsc" event={"ID":"860fa8b0-d877-4314-b97e-97eb26ee337b","Type":"ContainerStarted","Data":"3abd71528c246642b0f415ecb2d237849043f4fade6c1d59c425537fec749dfb"} Sep 17 17:35:14.508894 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.508819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h5gsc" Sep 17 17:35:14.510185 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.510161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48pl7" event={"ID":"a131a629-0149-4409-b083-a4dd34ea74d4","Type":"ContainerStarted","Data":"ca3674acc3caf13250f26da958e035ef47922e6c8c6645a290fcbde53acef32a"} Sep 17 17:35:14.510293 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.510275 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:35:14.539808 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.539770 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h5gsc" podStartSLOduration=33.048127001 podStartE2EDuration="37.53975719s" totalImagesPullingTime="4.491630189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:14.538535256 +0000 UTC m=+73.714929360" watchObservedRunningTime="2026-09-17 17:35:14.53975719 +0000 UTC m=+73.716151292" Sep 17 17:35:14.540339 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.540317 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-scddx" podStartSLOduration=66.691563323 podStartE2EDuration="1m11.540310204s" totalImagesPullingTime="4.848746881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:14.522336675 +0000 UTC m=+73.698730781" watchObservedRunningTime="2026-09-17 17:35:14.540310204 +0000 UTC m=+73.716704307" Sep 17 17:35:14.554461 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:14.554426 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-48pl7" podStartSLOduration=66.70816438 podStartE2EDuration="1m11.554414657s" totalImagesPullingTime="4.846250277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:14.553582994 +0000 UTC m=+73.729977111" watchObservedRunningTime="2026-09-17 17:35:14.554414657 +0000 UTC m=+73.730808751" Sep 17 17:35:17.703152 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:17.703047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:17.705344 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:17.705318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"image-registry-599677c649-btcf6\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:17.907917 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:17.907893 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jxpgb\"" Sep 17 17:35:17.916591 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:17.916578 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:18.196838 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.196808 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599677c649-btcf6"] Sep 17 17:35:18.200074 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:18.200047 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3519099_f840_42c7_912d_8c7c29d282a2.slice/crio-7807b4f77c5e2d41d72772b396ace267800422ad3c7253cd01a10ae745673485 WatchSource:0}: Error finding container 7807b4f77c5e2d41d72772b396ace267800422ad3c7253cd01a10ae745673485: Status 404 returned error can't find the container with id 7807b4f77c5e2d41d72772b396ace267800422ad3c7253cd01a10ae745673485 Sep 17 17:35:18.245534 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.245511 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-52vn2"] Sep 17 17:35:18.247288 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.247263 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.249655 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.249539 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 17:35:18.249655 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.249552 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 17:35:18.249655 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.249641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nklf8\"" Sep 17 17:35:18.266475 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.266454 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-52vn2"] Sep 17 17:35:18.306806 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.306772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/192384f4-56e7-4b2f-b553-522cdd885106-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-52vn2\" (UID: \"192384f4-56e7-4b2f-b553-522cdd885106\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.306962 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.306824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/192384f4-56e7-4b2f-b553-522cdd885106-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-52vn2\" (UID: \"192384f4-56e7-4b2f-b553-522cdd885106\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.312036 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.312002 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-599677c649-btcf6"] Sep 17 17:35:18.340811 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.340783 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-2cs65"] Sep 17 17:35:18.342736 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.342719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:18.347271 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.347253 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-49jxd\"" Sep 17 17:35:18.347386 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.347307 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 17:35:18.347630 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.347611 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 17:35:18.373869 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.373843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-2cs65"] Sep 17 17:35:18.407873 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.407844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/192384f4-56e7-4b2f-b553-522cdd885106-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-52vn2\" (UID: \"192384f4-56e7-4b2f-b553-522cdd885106\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.408038 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.407894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/192384f4-56e7-4b2f-b553-522cdd885106-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-52vn2\" (UID: \"192384f4-56e7-4b2f-b553-522cdd885106\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.408038 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.407925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6b46\" (UniqueName: \"kubernetes.io/projected/92999969-294d-4e0f-86a4-20e60c755917-kube-api-access-x6b46\") pod \"downloads-6594f4c75-2cs65\" (UID: \"92999969-294d-4e0f-86a4-20e60c755917\") " pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:18.408568 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.408543 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/192384f4-56e7-4b2f-b553-522cdd885106-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-52vn2\" (UID: \"192384f4-56e7-4b2f-b553-522cdd885106\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.410205 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.410184 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/192384f4-56e7-4b2f-b553-522cdd885106-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-52vn2\" (UID: \"192384f4-56e7-4b2f-b553-522cdd885106\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.509122 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.509029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6b46\" (UniqueName: \"kubernetes.io/projected/92999969-294d-4e0f-86a4-20e60c755917-kube-api-access-x6b46\") pod \"downloads-6594f4c75-2cs65\" (UID: \"92999969-294d-4e0f-86a4-20e60c755917\") " pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:18.524226 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.524200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6b46\" (UniqueName: \"kubernetes.io/projected/92999969-294d-4e0f-86a4-20e60c755917-kube-api-access-x6b46\") pod \"downloads-6594f4c75-2cs65\" (UID: \"92999969-294d-4e0f-86a4-20e60c755917\") " pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:18.525834 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.525809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599677c649-btcf6" event={"ID":"a3519099-f840-42c7-912d-8c7c29d282a2","Type":"ContainerStarted","Data":"e71a3373b92f25b40ab10c152ef09cb364f75e1d012a0fc15c3204bc7e388d8f"} Sep 17 17:35:18.525936 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.525876 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599677c649-btcf6" event={"ID":"a3519099-f840-42c7-912d-8c7c29d282a2","Type":"ContainerStarted","Data":"7807b4f77c5e2d41d72772b396ace267800422ad3c7253cd01a10ae745673485"} Sep 17 17:35:18.526001 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.525940 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:18.558471 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.558440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" Sep 17 17:35:18.579802 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.579739 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-599677c649-btcf6" podStartSLOduration=33.579719057 podStartE2EDuration="33.579719057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:18.579375221 +0000 UTC m=+77.755769325" watchObservedRunningTime="2026-09-17 17:35:18.579719057 +0000 UTC m=+77.756113162" Sep 17 17:35:18.650930 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.650884 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:18.832852 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.832821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-52vn2"] Sep 17 17:35:18.837204 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:18.837180 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192384f4_56e7_4b2f_b553_522cdd885106.slice/crio-b68c981cf7cdcc627bfb1d5ea739d4e341b2f0855158aaab37e3632e541e6a06 WatchSource:0}: Error finding container b68c981cf7cdcc627bfb1d5ea739d4e341b2f0855158aaab37e3632e541e6a06: Status 404 returned error can't find the container with id b68c981cf7cdcc627bfb1d5ea739d4e341b2f0855158aaab37e3632e541e6a06 Sep 17 17:35:18.921390 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:18.921363 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-2cs65"] Sep 17 17:35:18.924507 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:18.924486 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92999969_294d_4e0f_86a4_20e60c755917.slice/crio-b6709721b524b6ab2d346d39be9732ffab86cdf6f9de2ae55cd03738020fd6a1 WatchSource:0}: Error finding container b6709721b524b6ab2d346d39be9732ffab86cdf6f9de2ae55cd03738020fd6a1: Status 404 returned error can't find the container with id b6709721b524b6ab2d346d39be9732ffab86cdf6f9de2ae55cd03738020fd6a1 Sep 17 17:35:19.532209 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:19.532165 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-2cs65" event={"ID":"92999969-294d-4e0f-86a4-20e60c755917","Type":"ContainerStarted","Data":"b6709721b524b6ab2d346d39be9732ffab86cdf6f9de2ae55cd03738020fd6a1"} Sep 17 17:35:19.533987 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:19.533940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" event={"ID":"192384f4-56e7-4b2f-b553-522cdd885106","Type":"ContainerStarted","Data":"b68c981cf7cdcc627bfb1d5ea739d4e341b2f0855158aaab37e3632e541e6a06"} Sep 17 17:35:20.306107 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.306079 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42"] Sep 17 17:35:20.309773 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.309749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:20.311890 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.311866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 17:35:20.311890 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.311880 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w2f7f\"" Sep 17 17:35:20.316829 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.316800 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42"] Sep 17 17:35:20.429190 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.429153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/19b477c3-a650-4576-90f3-ea94355a45f2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-s5v42\" (UID: \"19b477c3-a650-4576-90f3-ea94355a45f2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:20.530184 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.530146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/19b477c3-a650-4576-90f3-ea94355a45f2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-s5v42\" (UID: \"19b477c3-a650-4576-90f3-ea94355a45f2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:20.530351 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:20.530253 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 17:35:20.530351 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:20.530329 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b477c3-a650-4576-90f3-ea94355a45f2-tls-certificates podName:19b477c3-a650-4576-90f3-ea94355a45f2 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.030307958 +0000 UTC m=+80.206702060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/19b477c3-a650-4576-90f3-ea94355a45f2-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-s5v42" (UID: "19b477c3-a650-4576-90f3-ea94355a45f2") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 17:35:20.538803 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.538766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" event={"ID":"192384f4-56e7-4b2f-b553-522cdd885106","Type":"ContainerStarted","Data":"7efab5be75007dae11a8d87a8967f6ad42a4af9359db5b17a3b712be14431387"} Sep 17 17:35:20.560723 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:20.560643 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-52vn2" podStartSLOduration=1.547391804 podStartE2EDuration="2.560629689s" totalImagesPullingTime="1.013237885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:20.559853218 +0000 UTC m=+79.736247318" watchObservedRunningTime="2026-09-17 17:35:20.560629689 +0000 UTC m=+79.737023797" Sep 17 17:35:21.033380 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:21.033345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/19b477c3-a650-4576-90f3-ea94355a45f2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-s5v42\" (UID: \"19b477c3-a650-4576-90f3-ea94355a45f2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:21.036139 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:21.036115 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/19b477c3-a650-4576-90f3-ea94355a45f2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-s5v42\" (UID: \"19b477c3-a650-4576-90f3-ea94355a45f2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:21.220827 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:21.220789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:21.500866 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:21.500788 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42"] Sep 17 17:35:21.503874 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:21.503849 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b477c3_a650_4576_90f3_ea94355a45f2.slice/crio-7736ee3f1444a5389ba08c94c467e509a14ece5cce34674687f0356a49fc4aaf WatchSource:0}: Error finding container 7736ee3f1444a5389ba08c94c467e509a14ece5cce34674687f0356a49fc4aaf: Status 404 returned error can't find the container with id 7736ee3f1444a5389ba08c94c467e509a14ece5cce34674687f0356a49fc4aaf Sep 17 17:35:21.545417 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:21.545364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" event={"ID":"19b477c3-a650-4576-90f3-ea94355a45f2","Type":"ContainerStarted","Data":"7736ee3f1444a5389ba08c94c467e509a14ece5cce34674687f0356a49fc4aaf"} Sep 17 17:35:23.553116 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:23.553078 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" event={"ID":"19b477c3-a650-4576-90f3-ea94355a45f2","Type":"ContainerStarted","Data":"71f29d961e66b8ea264363819282e0920b03f329ccf9b047849fdf8c29dc610b"} Sep 17 17:35:23.553585 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:23.553274 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:23.558662 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:23.558636 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" Sep 17 17:35:23.570857 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:23.570798 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-s5v42" podStartSLOduration=2.512857419 podStartE2EDuration="3.570779467s" totalImagesPullingTime="1.057922048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:23.569889277 +0000 UTC m=+82.746283382" watchObservedRunningTime="2026-09-17 17:35:23.570779467 +0000 UTC m=+82.747173573" Sep 17 17:35:24.381611 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.381583 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl"] Sep 17 17:35:24.387015 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.386987 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.389703 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.389682 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g6xns\"" Sep 17 17:35:24.389804 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.389738 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 17:35:24.389804 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.389796 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 17:35:24.389915 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.389749 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 17:35:24.390014 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.389997 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 17:35:24.390203 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.390053 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 17:35:24.392516 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.392439 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl"] Sep 17 17:35:24.458831 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.458798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmlt2\" (UniqueName: \"kubernetes.io/projected/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-kube-api-access-kmlt2\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.458949 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.458859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.458949 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.458894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.458949 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.458940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.515560 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.515538 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h5gsc" Sep 17 17:35:24.560144 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.560117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmlt2\" (UniqueName: \"kubernetes.io/projected/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-kube-api-access-kmlt2\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.560598 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.560173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.560598 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.560212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.560598 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.560272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.560598 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:24.560518 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 17:35:24.560598 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:24.560589 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-tls podName:7e6f0e5b-6302-43d4-8ed4-4be937b12d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:25.060569921 +0000 UTC m=+84.236964016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-fvztl" (UID: "7e6f0e5b-6302-43d4-8ed4-4be937b12d8f") : secret "prometheus-operator-tls" not found Sep 17 17:35:24.561070 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.561051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.564607 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.564582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.571433 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.571367 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmlt2\" (UniqueName: \"kubernetes.io/projected/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-kube-api-access-kmlt2\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:24.661630 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.661561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:24.664460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.664438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab6443fa-e410-40c4-9b6e-b23609af2fc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bldj9\" (UID: \"ab6443fa-e410-40c4-9b6e-b23609af2fc4\") " pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:24.947477 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.947385 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7fflr\"" Sep 17 17:35:24.956079 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:24.956047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bldj9" Sep 17 17:35:25.065056 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.065023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:25.068252 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.068227 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e6f0e5b-6302-43d4-8ed4-4be937b12d8f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-fvztl\" (UID: \"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:25.237986 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.237914 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bldj9"] Sep 17 17:35:25.241547 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:25.241520 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6443fa_e410_40c4_9b6e_b23609af2fc4.slice/crio-def3ab211822bc5e14a16fc49e9d5886454f0a84c5cbc30ce09c5445d6ebbf2b WatchSource:0}: Error finding container def3ab211822bc5e14a16fc49e9d5886454f0a84c5cbc30ce09c5445d6ebbf2b: Status 404 returned error can't find the container with id def3ab211822bc5e14a16fc49e9d5886454f0a84c5cbc30ce09c5445d6ebbf2b Sep 17 17:35:25.298472 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.298450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" Sep 17 17:35:25.562557 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.562521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bldj9" event={"ID":"ab6443fa-e410-40c4-9b6e-b23609af2fc4","Type":"ContainerStarted","Data":"1ce9275c3c2d946025ec7ffc02f0e56df675f96759f511741027fadf9a1e5e79"} Sep 17 17:35:25.562964 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.562589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bldj9" event={"ID":"ab6443fa-e410-40c4-9b6e-b23609af2fc4","Type":"ContainerStarted","Data":"def3ab211822bc5e14a16fc49e9d5886454f0a84c5cbc30ce09c5445d6ebbf2b"} Sep 17 17:35:25.589141 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:25.589104 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl"] Sep 17 17:35:25.592806 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:25.592781 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6f0e5b_6302_43d4_8ed4_4be937b12d8f.slice/crio-c7c92004b75bacd496468bf0daeba72509bcd32b841bf269a1cd5f912e0267d9 WatchSource:0}: Error finding container c7c92004b75bacd496468bf0daeba72509bcd32b841bf269a1cd5f912e0267d9: Status 404 returned error can't find the container with id c7c92004b75bacd496468bf0daeba72509bcd32b841bf269a1cd5f912e0267d9 Sep 17 17:35:26.569799 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:26.569754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bldj9" event={"ID":"ab6443fa-e410-40c4-9b6e-b23609af2fc4","Type":"ContainerStarted","Data":"3715f6c71263c72f8f91167c1561e830e9e3134decdadef143eb581660d844c9"} Sep 17 17:35:26.571457 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:26.571425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" event={"ID":"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f","Type":"ContainerStarted","Data":"c7c92004b75bacd496468bf0daeba72509bcd32b841bf269a1cd5f912e0267d9"} Sep 17 17:35:27.577882 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:27.577846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bldj9" event={"ID":"ab6443fa-e410-40c4-9b6e-b23609af2fc4","Type":"ContainerStarted","Data":"71cd7b0c8acad4a40ec50a3448cecc06e0e6c3b34096250a628ce7f904eed7e4"} Sep 17 17:35:27.579982 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:27.579959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" event={"ID":"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f","Type":"ContainerStarted","Data":"10682a2a3be5b7c74aa1ec50ecad36073a28b8590e19cc996f2e7eb3550928de"} Sep 17 17:35:27.580088 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:27.580009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" event={"ID":"7e6f0e5b-6302-43d4-8ed4-4be937b12d8f","Type":"ContainerStarted","Data":"56fe1324dbe09f92b1caf59d579342f7a030ff7fe233f65bcb59db195c149781"} Sep 17 17:35:27.597296 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:27.597252 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bldj9" podStartSLOduration=33.532140262 podStartE2EDuration="35.597239232s" totalImagesPullingTime="2.06509897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:27.596990336 +0000 UTC m=+86.773384440" watchObservedRunningTime="2026-09-17 17:35:27.597239232 +0000 UTC m=+86.773633337" Sep 17 17:35:27.617047 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:27.617004 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-fvztl" podStartSLOduration=2.295652293 podStartE2EDuration="3.616987303s" totalImagesPullingTime="1.32133501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:27.61662218 +0000 UTC m=+86.793016295" watchObservedRunningTime="2026-09-17 17:35:27.616987303 +0000 UTC m=+86.793381408" Sep 17 17:35:29.853291 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:29.853228 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mczh2"] Sep 17 17:35:29.888716 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:29.887780 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:29.890829 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:29.890443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 17:35:29.890829 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:29.890499 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m5jv7\"" Sep 17 17:35:29.890829 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:29.890443 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 17:35:29.890829 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:29.890690 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 17:35:30.005908 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.005876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-root\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.005925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-wtmp\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.005951 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-tls\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.005977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-textfile\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.005995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-sys\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.006032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.006063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-accelerators-collector-config\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.006088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m94r\" (UniqueName: \"kubernetes.io/projected/fe05b634-011f-414c-820f-2418ee7ec55c-kube-api-access-5m94r\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.006364 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.006133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe05b634-011f-414c-820f-2418ee7ec55c-metrics-client-ca\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107223 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-wtmp\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107223 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-tls\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107223 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-textfile\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-sys\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-accelerators-collector-config\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m94r\" (UniqueName: \"kubernetes.io/projected/fe05b634-011f-414c-820f-2418ee7ec55c-kube-api-access-5m94r\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:30.107352 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe05b634-011f-414c-820f-2418ee7ec55c-metrics-client-ca\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-root\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:35:30.107441 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-tls podName:fe05b634-011f-414c-820f-2418ee7ec55c nodeName:}" failed. No retries permitted until 2026-09-17 17:35:30.607420234 +0000 UTC m=+89.783814335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-tls") pod "node-exporter-mczh2" (UID: "fe05b634-011f-414c-820f-2418ee7ec55c") : secret "node-exporter-tls" not found Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107452 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-root\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107352 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-wtmp\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.107546 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107525 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe05b634-011f-414c-820f-2418ee7ec55c-sys\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.108095 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.107608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-textfile\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.108095 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.108002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe05b634-011f-414c-820f-2418ee7ec55c-metrics-client-ca\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.108095 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.108062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-accelerators-collector-config\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.110124 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.110082 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.126530 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.126501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m94r\" (UniqueName: \"kubernetes.io/projected/fe05b634-011f-414c-820f-2418ee7ec55c-kube-api-access-5m94r\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.610740 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.610698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-tls\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.613166 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.613138 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe05b634-011f-414c-820f-2418ee7ec55c-node-exporter-tls\") pod \"node-exporter-mczh2\" (UID: \"fe05b634-011f-414c-820f-2418ee7ec55c\") " pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.799568 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.799529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mczh2" Sep 17 17:35:30.941674 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.941594 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:35:30.962657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.962580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:35:30.963428 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.963301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:30.966850 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.966821 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:35:30.967304 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.967285 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:35:30.967440 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.967416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:35:30.967722 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.967688 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:35:30.967803 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.967793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:35:30.968169 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.968014 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:35:30.968349 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.968311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:35:30.968597 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.968580 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6ljvx\"" Sep 17 17:35:30.968697 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.968684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:35:30.968871 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:30.968821 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:35:31.114141 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-volume\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzwrh\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-kube-api-access-qzwrh\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114313 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-out\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114588 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114588 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-tls-assets\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114588 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114588 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114588 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114588 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-web-config\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.114837 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.114623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216048 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.215959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216048 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216048 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216310 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-web-config\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216431 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216632 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216632 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-volume\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216632 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwrh\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-kube-api-access-qzwrh\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216632 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-out\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216813 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.216813 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.216680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-tls-assets\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.217653 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.217208 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.218073 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.217887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.218593 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.218565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.219852 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.219824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-out\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.219949 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.219850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.220735 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.220289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-tls-assets\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.220735 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.220548 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.220735 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.220698 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.221052 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.220987 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.221190 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.221054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-web-config\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.221692 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.221672 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.221879 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.221839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-volume\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.226734 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.226706 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzwrh\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-kube-api-access-qzwrh\") pod \"alertmanager-main-0\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.279741 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.279700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:35:31.907306 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.907275 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-99fd6b7d-7dcpr"] Sep 17 17:35:31.910043 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.910018 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:31.912596 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.912577 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 17:35:31.912850 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.912827 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 17:35:31.913143 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.913126 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 17:35:31.913308 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.913293 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-19reih7qqc4ha\"" Sep 17 17:35:31.913671 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.913652 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2rqd5\"" Sep 17 17:35:31.913797 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.913653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 17:35:31.913797 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.913653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 17:35:31.922092 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:31.922071 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99fd6b7d-7dcpr"] Sep 17 17:35:32.023201 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-tls\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-metrics-client-ca\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-grpc-tls\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctvm\" (UniqueName: \"kubernetes.io/projected/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-kube-api-access-4ctvm\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.023657 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.023487 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124701 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124701 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124701 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-tls\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124834 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-metrics-client-ca\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124880 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-grpc-tls\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.124931 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.124886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctvm\" (UniqueName: \"kubernetes.io/projected/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-kube-api-access-4ctvm\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.125640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.125591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-metrics-client-ca\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.127615 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.127585 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-tls\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.127702 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.127610 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.127750 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.127700 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-grpc-tls\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.127750 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.127721 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.128164 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.128145 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.128297 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.128275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.134649 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.134627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctvm\" (UniqueName: \"kubernetes.io/projected/900a7b4d-e704-4f3d-ab7e-4d5d4027fd46-kube-api-access-4ctvm\") pod \"thanos-querier-99fd6b7d-7dcpr\" (UID: \"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46\") " pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:32.222649 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:32.222582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:34.613722 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.613687 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q"] Sep 17 17:35:34.619666 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.619648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.622452 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.622335 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v6q2t\"" Sep 17 17:35:34.622452 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.622410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 17:35:34.629976 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.629956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q"] Sep 17 17:35:34.744659 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.744625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9763d7e1-c7ed-4af6-a2ce-93a718fe6616-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-5dw4q\" (UID: \"9763d7e1-c7ed-4af6-a2ce-93a718fe6616\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.744824 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.744701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbns\" (UniqueName: \"kubernetes.io/projected/9763d7e1-c7ed-4af6-a2ce-93a718fe6616-kube-api-access-7zbns\") pod \"monitoring-plugin-5984459ff8-5dw4q\" (UID: \"9763d7e1-c7ed-4af6-a2ce-93a718fe6616\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.845750 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.845715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbns\" (UniqueName: \"kubernetes.io/projected/9763d7e1-c7ed-4af6-a2ce-93a718fe6616-kube-api-access-7zbns\") pod \"monitoring-plugin-5984459ff8-5dw4q\" (UID: \"9763d7e1-c7ed-4af6-a2ce-93a718fe6616\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.845901 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.845774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9763d7e1-c7ed-4af6-a2ce-93a718fe6616-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-5dw4q\" (UID: \"9763d7e1-c7ed-4af6-a2ce-93a718fe6616\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.848423 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.848380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9763d7e1-c7ed-4af6-a2ce-93a718fe6616-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-5dw4q\" (UID: \"9763d7e1-c7ed-4af6-a2ce-93a718fe6616\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.855215 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.855194 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbns\" (UniqueName: \"kubernetes.io/projected/9763d7e1-c7ed-4af6-a2ce-93a718fe6616-kube-api-access-7zbns\") pod \"monitoring-plugin-5984459ff8-5dw4q\" (UID: \"9763d7e1-c7ed-4af6-a2ce-93a718fe6616\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:34.932782 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:34.932715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:35.002808 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.002781 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc"] Sep 17 17:35:35.006134 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.006114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.009195 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.008988 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 17:35:35.009195 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.008996 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 17:35:35.009195 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.009022 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 17:35:35.009195 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.009144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 17:35:35.009560 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.009539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 17:35:35.009667 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.009542 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qkrx2\"" Sep 17 17:35:35.013076 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.013058 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 17:35:35.020695 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.020666 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc"] Sep 17 17:35:35.149134 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-secret-telemeter-client\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkwh\" (UniqueName: \"kubernetes.io/projected/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-kube-api-access-dlkwh\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-telemeter-client-tls\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-serving-certs-ca-bundle\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149462 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149462 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-metrics-client-ca\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.149462 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.149369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-federate-client-tls\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-metrics-client-ca\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250548 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-federate-client-tls\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250548 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-secret-telemeter-client\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250548 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250801 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkwh\" (UniqueName: \"kubernetes.io/projected/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-kube-api-access-dlkwh\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250896 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-telemeter-client-tls\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.250896 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.250858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-serving-certs-ca-bundle\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.251412 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.251104 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-metrics-client-ca\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.251516 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.251444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.251571 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.251542 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-serving-certs-ca-bundle\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.253085 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.253066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-secret-telemeter-client\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.253976 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.253957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-federate-client-tls\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.254082 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.254051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.254082 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.254064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-telemeter-client-tls\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.264488 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.264458 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkwh\" (UniqueName: \"kubernetes.io/projected/1369f48c-bbe7-48e8-866c-4c6f2c8db14b-kube-api-access-dlkwh\") pod \"telemeter-client-69bd7cbbd6-p49lc\" (UID: \"1369f48c-bbe7-48e8-866c-4c6f2c8db14b\") " pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.278872 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.278849 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99fd6b7d-7dcpr"] Sep 17 17:35:35.282245 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:35.282221 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900a7b4d_e704_4f3d_ab7e_4d5d4027fd46.slice/crio-840f99c6dd59b9194875937c64cad25dfad9d1043403a66b107d3d7770b7e7fd WatchSource:0}: Error finding container 840f99c6dd59b9194875937c64cad25dfad9d1043403a66b107d3d7770b7e7fd: Status 404 returned error can't find the container with id 840f99c6dd59b9194875937c64cad25dfad9d1043403a66b107d3d7770b7e7fd Sep 17 17:35:35.313820 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.313797 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q"] Sep 17 17:35:35.316166 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:35.316140 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9763d7e1_c7ed_4af6_a2ce_93a718fe6616.slice/crio-308ce7e2765cbf94ed2687b799c8cac369273c760c8b826ed02b61bb21ee612d WatchSource:0}: Error finding container 308ce7e2765cbf94ed2687b799c8cac369273c760c8b826ed02b61bb21ee612d: Status 404 returned error can't find the container with id 308ce7e2765cbf94ed2687b799c8cac369273c760c8b826ed02b61bb21ee612d Sep 17 17:35:35.321053 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.321027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" Sep 17 17:35:35.321470 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.321384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:35:35.323658 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:35.323635 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761d8f9b_ac2c_4a8f_bfdf_9d2295682981.slice/crio-a7da13f2a97600ca9ef1bad6a7714bca1e34db66fb6bfaecc6ddcc2e39a8184e WatchSource:0}: Error finding container a7da13f2a97600ca9ef1bad6a7714bca1e34db66fb6bfaecc6ddcc2e39a8184e: Status 404 returned error can't find the container with id a7da13f2a97600ca9ef1bad6a7714bca1e34db66fb6bfaecc6ddcc2e39a8184e Sep 17 17:35:35.605214 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.605180 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc"] Sep 17 17:35:35.608859 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:35:35.608805 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1369f48c_bbe7_48e8_866c_4c6f2c8db14b.slice/crio-505d4372bc9478843469c3883c8182f639a6778c50180a533e488b8c6210734d WatchSource:0}: Error finding container 505d4372bc9478843469c3883c8182f639a6778c50180a533e488b8c6210734d: Status 404 returned error can't find the container with id 505d4372bc9478843469c3883c8182f639a6778c50180a533e488b8c6210734d Sep 17 17:35:35.615087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.614985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"a7da13f2a97600ca9ef1bad6a7714bca1e34db66fb6bfaecc6ddcc2e39a8184e"} Sep 17 17:35:35.616963 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.616932 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"840f99c6dd59b9194875937c64cad25dfad9d1043403a66b107d3d7770b7e7fd"} Sep 17 17:35:35.619037 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.619010 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-2cs65" event={"ID":"92999969-294d-4e0f-86a4-20e60c755917","Type":"ContainerStarted","Data":"cc023da1a4d2747f2848e7d35acd330e4d057eb39bf91b47b5d193797345bd12"} Sep 17 17:35:35.619329 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.619298 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:35.620625 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.620599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mczh2" event={"ID":"fe05b634-011f-414c-820f-2418ee7ec55c","Type":"ContainerStarted","Data":"745499739ae5ecba826c4ca4a7b549c9b5fe8ff874b87779f461f12d41ea3454"} Sep 17 17:35:35.622027 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.622004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" event={"ID":"9763d7e1-c7ed-4af6-a2ce-93a718fe6616","Type":"ContainerStarted","Data":"308ce7e2765cbf94ed2687b799c8cac369273c760c8b826ed02b61bb21ee612d"} Sep 17 17:35:35.630326 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.630299 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-2cs65" Sep 17 17:35:35.639089 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:35.639044 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-2cs65" podStartSLOduration=1.45986846 podStartE2EDuration="17.639028183s" totalImagesPullingTime="16.179159723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:35.637771964 +0000 UTC m=+94.814166091" watchObservedRunningTime="2026-09-17 17:35:35.639028183 +0000 UTC m=+94.815422288" Sep 17 17:35:36.630757 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:36.630715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" event={"ID":"1369f48c-bbe7-48e8-866c-4c6f2c8db14b","Type":"ContainerStarted","Data":"505d4372bc9478843469c3883c8182f639a6778c50180a533e488b8c6210734d"} Sep 17 17:35:39.540531 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:39.540501 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:40.652858 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.652825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" event={"ID":"1369f48c-bbe7-48e8-866c-4c6f2c8db14b","Type":"ContainerStarted","Data":"7451c4f5528b41142d59b952dac233bf46682e5b925018e8bcdb51303f29254d"} Sep 17 17:35:40.653207 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.652929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" event={"ID":"1369f48c-bbe7-48e8-866c-4c6f2c8db14b","Type":"ContainerStarted","Data":"f936a76cdc9e6f482b73684b8243dc162cc52a6b6aa5465ec635cdb7cb21202d"} Sep 17 17:35:40.655315 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.655285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"e7bed34978344a4d2db1eb6e08000d260f81224e702b9f2ba1498283bcc44977"} Sep 17 17:35:40.655443 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.655361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"fc779b6f1a4fba402c9f910393f331f83de2c7d3ca43e3ec04ddee6ec0114375"} Sep 17 17:35:40.658117 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.657494 2580 generic.go:356] "Generic (PLEG): container finished" podID="fe05b634-011f-414c-820f-2418ee7ec55c" containerID="af551aac8ac9748cde1c99dc05cd38aa89f1819c2878ee2f1db8548422bf6e78" exitCode=0 Sep 17 17:35:40.658117 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.657583 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mczh2" event={"ID":"fe05b634-011f-414c-820f-2418ee7ec55c","Type":"ContainerDied","Data":"af551aac8ac9748cde1c99dc05cd38aa89f1819c2878ee2f1db8548422bf6e78"} Sep 17 17:35:40.662488 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.660836 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" event={"ID":"9763d7e1-c7ed-4af6-a2ce-93a718fe6616","Type":"ContainerStarted","Data":"07dffaec3ea225ce990c02db8fdc611df265679992315cbd0323122ad187d2e3"} Sep 17 17:35:40.663860 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.663303 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:40.668676 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.668499 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" Sep 17 17:35:40.668676 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.668562 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41" exitCode=0 Sep 17 17:35:40.668676 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.668615 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41"} Sep 17 17:35:40.711927 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:40.711859 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-5dw4q" podStartSLOduration=1.891574228 podStartE2EDuration="6.711838747s" totalImagesPullingTime="4.820264519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:40.711322695 +0000 UTC m=+99.887716800" watchObservedRunningTime="2026-09-17 17:35:40.711838747 +0000 UTC m=+99.888232852" Sep 17 17:35:41.675946 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:41.675911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" event={"ID":"1369f48c-bbe7-48e8-866c-4c6f2c8db14b","Type":"ContainerStarted","Data":"6e8bd68b31d308d42ef8524ad5d439d4875151af312f489cce180ac703788550"} Sep 17 17:35:41.678519 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:41.678492 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"5e2db3eb85fe40b276fa1efe3afd93f0598350423d3ccbc8c89440e3bfcb4f54"} Sep 17 17:35:41.681496 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:41.681470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mczh2" event={"ID":"fe05b634-011f-414c-820f-2418ee7ec55c","Type":"ContainerStarted","Data":"7bd41cc88b1a45dfc817a806443b340542a7b92f49386cb8109c853ea4cf079c"} Sep 17 17:35:41.681593 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:41.681512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mczh2" event={"ID":"fe05b634-011f-414c-820f-2418ee7ec55c","Type":"ContainerStarted","Data":"e81bd5d105b11983308fae0b7bd37167847bc830bbe151dc02ff288393d13ced"} Sep 17 17:35:41.700751 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:41.700710 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69bd7cbbd6-p49lc" podStartSLOduration=3.167526097 podStartE2EDuration="7.700696285s" totalImagesPullingTime="4.533170188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:41.699887684 +0000 UTC m=+100.876281788" watchObservedRunningTime="2026-09-17 17:35:41.700696285 +0000 UTC m=+100.877090389" Sep 17 17:35:42.699205 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:42.699170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"c1012cc2ea35538b39082c7bf0a359a1665ec86c7daa4214ada7ce38a0ae25ef"} Sep 17 17:35:42.699621 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:42.699597 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"6571858b402e7b904e571639784c65a51d85e46ffd7a144f826185047a9133b2"} Sep 17 17:35:43.706631 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.706596 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f"} Sep 17 17:35:43.706972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.706694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351"} Sep 17 17:35:43.706972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.706737 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8"} Sep 17 17:35:43.706972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.706782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6"} Sep 17 17:35:43.706972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.706821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86"} Sep 17 17:35:43.709733 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.709701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" event={"ID":"900a7b4d-e704-4f3d-ab7e-4d5d4027fd46","Type":"ContainerStarted","Data":"b28e0fafbed9fc038872f75e4e15162aa7bc0789bb4d0bd62b08d5beafab14e7"} Sep 17 17:35:43.709880 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.709861 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:35:43.741375 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.741333 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" podStartSLOduration=6.626155524 podStartE2EDuration="12.741318875s" totalImagesPullingTime="6.115163351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:43.74065573 +0000 UTC m=+102.917049836" watchObservedRunningTime="2026-09-17 17:35:43.741318875 +0000 UTC m=+102.917713000" Sep 17 17:35:43.741918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:43.741893 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mczh2" podStartSLOduration=9.540808506 podStartE2EDuration="14.741884434s" totalImagesPullingTime="5.10444174s" totalInitContainerRuntime="96.634188ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:41.726505443 +0000 UTC m=+100.902899558" watchObservedRunningTime="2026-09-17 17:35:43.741884434 +0000 UTC m=+102.918278534" Sep 17 17:35:44.557824 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.557784 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-599677c649-btcf6" podUID="a3519099-f840-42c7-912d-8c7c29d282a2" containerName="registry" containerID="cri-o://e71a3373b92f25b40ab10c152ef09cb364f75e1d012a0fc15c3204bc7e388d8f" gracePeriod=30 Sep 17 17:35:44.718437 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.718381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerStarted","Data":"f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601"} Sep 17 17:35:44.720066 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.720038 2580 generic.go:356] "Generic (PLEG): container finished" podID="a3519099-f840-42c7-912d-8c7c29d282a2" containerID="e71a3373b92f25b40ab10c152ef09cb364f75e1d012a0fc15c3204bc7e388d8f" exitCode=0 Sep 17 17:35:44.720178 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.720092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599677c649-btcf6" event={"ID":"a3519099-f840-42c7-912d-8c7c29d282a2","Type":"ContainerDied","Data":"e71a3373b92f25b40ab10c152ef09cb364f75e1d012a0fc15c3204bc7e388d8f"} Sep 17 17:35:44.751239 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.751182 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.562011859 podStartE2EDuration="14.751161399s" totalImagesPullingTime="7.1689191s" totalInitContainerRuntime="20.23044ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:44.750079522 +0000 UTC m=+103.926473626" watchObservedRunningTime="2026-09-17 17:35:44.751161399 +0000 UTC m=+103.927555504" Sep 17 17:35:44.834539 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.834515 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:44.948848 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.948819 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79pdb\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-kube-api-access-79pdb\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949005 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.948856 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-trusted-ca\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949005 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.948875 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-bound-sa-token\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949005 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.948916 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949005 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.948955 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-installation-pull-secrets\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949196 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.949018 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3519099-f840-42c7-912d-8c7c29d282a2-ca-trust-extracted\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949196 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.949055 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-registry-certificates\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949196 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.949095 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-image-registry-private-configuration\") pod \"a3519099-f840-42c7-912d-8c7c29d282a2\" (UID: \"a3519099-f840-42c7-912d-8c7c29d282a2\") " Sep 17 17:35:44.949372 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.949269 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:35:44.949569 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.949511 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:35:44.951602 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.951569 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:35:44.951716 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.951629 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:35:44.951716 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.951658 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:35:44.951716 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.951683 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:35:44.951828 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.951743 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-kube-api-access-79pdb" (OuterVolumeSpecName: "kube-api-access-79pdb") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "kube-api-access-79pdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:35:44.959607 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:44.959582 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3519099-f840-42c7-912d-8c7c29d282a2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a3519099-f840-42c7-912d-8c7c29d282a2" (UID: "a3519099-f840-42c7-912d-8c7c29d282a2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:35:45.050438 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050387 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3519099-f840-42c7-912d-8c7c29d282a2-ca-trust-extracted\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050438 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050433 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-registry-certificates\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050438 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050442 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-image-registry-private-configuration\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050451 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79pdb\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-kube-api-access-79pdb\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050461 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3519099-f840-42c7-912d-8c7c29d282a2-trusted-ca\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050471 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-bound-sa-token\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050477 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3519099-f840-42c7-912d-8c7c29d282a2-registry-tls\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.050640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.050484 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3519099-f840-42c7-912d-8c7c29d282a2-installation-pull-secrets\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:35:45.515922 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.515845 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-48pl7" Sep 17 17:35:45.726312 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.726278 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599677c649-btcf6" Sep 17 17:35:45.726796 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.726317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599677c649-btcf6" event={"ID":"a3519099-f840-42c7-912d-8c7c29d282a2","Type":"ContainerDied","Data":"7807b4f77c5e2d41d72772b396ace267800422ad3c7253cd01a10ae745673485"} Sep 17 17:35:45.726796 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.726371 2580 scope.go:117] "RemoveContainer" containerID="e71a3373b92f25b40ab10c152ef09cb364f75e1d012a0fc15c3204bc7e388d8f" Sep 17 17:35:45.746501 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.746477 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-599677c649-btcf6"] Sep 17 17:35:45.755740 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:45.755719 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-599677c649-btcf6"] Sep 17 17:35:47.082407 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:47.082373 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3519099-f840-42c7-912d-8c7c29d282a2" path="/var/lib/kubelet/pods/a3519099-f840-42c7-912d-8c7c29d282a2/volumes" Sep 17 17:35:49.726141 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:35:49.726116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-99fd6b7d-7dcpr" Sep 17 17:36:50.254361 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254283 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:36:50.254865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254578 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="alertmanager" containerID="cri-o://fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86" gracePeriod=120 Sep 17 17:36:50.254865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254633 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-metric" containerID="cri-o://665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f" gracePeriod=120 Sep 17 17:36:50.254865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254671 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-web" containerID="cri-o://86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8" gracePeriod=120 Sep 17 17:36:50.254865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254692 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="config-reloader" containerID="cri-o://a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6" gracePeriod=120 Sep 17 17:36:50.254865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254710 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy" containerID="cri-o://8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351" gracePeriod=120 Sep 17 17:36:50.254865 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.254749 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="prom-label-proxy" containerID="cri-o://f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601" gracePeriod=120 Sep 17 17:36:50.995962 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.995930 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601" exitCode=0 Sep 17 17:36:50.995962 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.995953 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f" exitCode=0 Sep 17 17:36:50.995962 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.995959 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351" exitCode=0 Sep 17 17:36:50.995962 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.995964 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6" exitCode=0 Sep 17 17:36:50.995962 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.995969 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86" exitCode=0 Sep 17 17:36:50.996237 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.995998 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601"} Sep 17 17:36:50.996237 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.996079 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f"} Sep 17 17:36:50.996237 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.996105 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351"} Sep 17 17:36:50.996237 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.996128 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6"} Sep 17 17:36:50.996237 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:50.996150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86"} Sep 17 17:36:51.496087 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.496064 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:51.653511 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653431 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653511 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653466 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-cluster-tls-config\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653511 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653489 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-web\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653511 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653507 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-out\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653841 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653624 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-web-config\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653841 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653682 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-metrics-client-ca\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653841 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653715 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-main-db\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653841 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653755 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-main-tls\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.653841 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653835 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-trusted-ca-bundle\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.654077 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653871 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.654077 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653921 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-tls-assets\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.654077 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653953 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-volume\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.654077 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.653980 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzwrh\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-kube-api-access-qzwrh\") pod \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\" (UID: \"761d8f9b-ac2c-4a8f-bfdf-9d2295682981\") " Sep 17 17:36:51.654077 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.654044 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:36:51.654077 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.654053 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:36:51.654363 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.654225 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-metrics-client-ca\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.654363 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.654243 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-main-db\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.656282 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.655463 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:36:51.656420 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.656296 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.657241 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.656890 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.657241 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.657207 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.657429 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.657328 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:36:51.657642 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.657620 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-kube-api-access-qzwrh" (OuterVolumeSpecName: "kube-api-access-qzwrh") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "kube-api-access-qzwrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:36:51.657714 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.657664 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-volume" (OuterVolumeSpecName: "config-volume") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.657842 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.657284 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-out" (OuterVolumeSpecName: "config-out") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:36:51.658134 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.658113 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.660923 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.660902 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.667379 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.667357 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-web-config" (OuterVolumeSpecName: "web-config") pod "761d8f9b-ac2c-4a8f-bfdf-9d2295682981" (UID: "761d8f9b-ac2c-4a8f-bfdf-9d2295682981"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:36:51.754981 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.754959 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-tls-assets\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.754981 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.754977 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-volume\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.754985 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzwrh\" (UniqueName: \"kubernetes.io/projected/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-kube-api-access-qzwrh\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.754995 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755003 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-cluster-tls-config\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755013 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755021 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-config-out\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755029 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-web-config\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755041 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-main-tls\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755049 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:51.755093 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:51.755058 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/761d8f9b-ac2c-4a8f-bfdf-9d2295682981-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:36:52.003259 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.003202 2580 generic.go:356] "Generic (PLEG): container finished" podID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerID="86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8" exitCode=0 Sep 17 17:36:52.003259 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.003236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8"} Sep 17 17:36:52.003383 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.003296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"761d8f9b-ac2c-4a8f-bfdf-9d2295682981","Type":"ContainerDied","Data":"a7da13f2a97600ca9ef1bad6a7714bca1e34db66fb6bfaecc6ddcc2e39a8184e"} Sep 17 17:36:52.003383 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.003298 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.003383 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.003329 2580 scope.go:117] "RemoveContainer" containerID="f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601" Sep 17 17:36:52.012097 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.012071 2580 scope.go:117] "RemoveContainer" containerID="665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f" Sep 17 17:36:52.019919 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.019898 2580 scope.go:117] "RemoveContainer" containerID="8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351" Sep 17 17:36:52.027706 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.027682 2580 scope.go:117] "RemoveContainer" containerID="86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8" Sep 17 17:36:52.029509 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.029486 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:36:52.034017 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.033995 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:36:52.034880 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.034860 2580 scope.go:117] "RemoveContainer" containerID="a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6" Sep 17 17:36:52.041359 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.041342 2580 scope.go:117] "RemoveContainer" containerID="fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86" Sep 17 17:36:52.048081 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.048065 2580 scope.go:117] "RemoveContainer" containerID="c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41" Sep 17 17:36:52.054710 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.054690 2580 scope.go:117] "RemoveContainer" containerID="f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601" Sep 17 17:36:52.054993 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.054971 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601\": container with ID starting with f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601 not found: ID does not exist" containerID="f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601" Sep 17 17:36:52.055032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055004 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601"} err="failed to get container status \"f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601\": rpc error: code = NotFound desc = could not find container \"f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601\": container with ID starting with f465db7086362ddf0025c9e3ada98bdf4cdc7b1cb7ff438966d789f5e3a60601 not found: ID does not exist" Sep 17 17:36:52.055086 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055032 2580 scope.go:117] "RemoveContainer" containerID="665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f" Sep 17 17:36:52.055287 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.055271 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f\": container with ID starting with 665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f not found: ID does not exist" containerID="665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f" Sep 17 17:36:52.055330 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055292 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f"} err="failed to get container status \"665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f\": rpc error: code = NotFound desc = could not find container \"665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f\": container with ID starting with 665fc931189e116caa24ab0d473f18e6dcf9f713dd11bd785856699f0f398c6f not found: ID does not exist" Sep 17 17:36:52.055330 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055307 2580 scope.go:117] "RemoveContainer" containerID="8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351" Sep 17 17:36:52.055528 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.055513 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351\": container with ID starting with 8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351 not found: ID does not exist" containerID="8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351" Sep 17 17:36:52.055576 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055532 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351"} err="failed to get container status \"8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351\": rpc error: code = NotFound desc = could not find container \"8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351\": container with ID starting with 8f13d9c3df0e63a0d7a86a645d7340cf4bda8187fc6915fafcae9d4f03dcc351 not found: ID does not exist" Sep 17 17:36:52.055576 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055547 2580 scope.go:117] "RemoveContainer" containerID="86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8" Sep 17 17:36:52.055744 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.055728 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8\": container with ID starting with 86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8 not found: ID does not exist" containerID="86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8" Sep 17 17:36:52.055787 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055747 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8"} err="failed to get container status \"86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8\": rpc error: code = NotFound desc = could not find container \"86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8\": container with ID starting with 86ec2dfa07209de95aa0066a9e83a0a064dfd1f19ebab951ddfb7944b9c21ae8 not found: ID does not exist" Sep 17 17:36:52.055787 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055760 2580 scope.go:117] "RemoveContainer" containerID="a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6" Sep 17 17:36:52.055981 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.055967 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6\": container with ID starting with a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6 not found: ID does not exist" containerID="a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6" Sep 17 17:36:52.056024 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055984 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6"} err="failed to get container status \"a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6\": rpc error: code = NotFound desc = could not find container \"a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6\": container with ID starting with a0402b25d2c97dcbf78cbf61ede8ead92b4b60df8b5467c738521bd1473f8dc6 not found: ID does not exist" Sep 17 17:36:52.056024 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.055995 2580 scope.go:117] "RemoveContainer" containerID="fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86" Sep 17 17:36:52.056172 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.056159 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86\": container with ID starting with fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86 not found: ID does not exist" containerID="fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86" Sep 17 17:36:52.056205 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.056174 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86"} err="failed to get container status \"fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86\": rpc error: code = NotFound desc = could not find container \"fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86\": container with ID starting with fc558c7c8b5db347261b00e533a76a75e76482fd08800bf007b546ec2cb02d86 not found: ID does not exist" Sep 17 17:36:52.056205 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.056185 2580 scope.go:117] "RemoveContainer" containerID="c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41" Sep 17 17:36:52.056371 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:36:52.056357 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41\": container with ID starting with c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41 not found: ID does not exist" containerID="c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41" Sep 17 17:36:52.056478 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.056373 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41"} err="failed to get container status \"c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41\": rpc error: code = NotFound desc = could not find container \"c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41\": container with ID starting with c61d026928d90bf884cc2fb813aeff1cc9cbee160962433908b356cb2700eb41 not found: ID does not exist" Sep 17 17:36:52.064196 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064176 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:36:52.064477 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064462 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064478 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064488 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-metric" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064493 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-metric" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064503 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="config-reloader" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064508 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="config-reloader" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064515 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3519099-f840-42c7-912d-8c7c29d282a2" containerName="registry" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064520 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3519099-f840-42c7-912d-8c7c29d282a2" containerName="registry" Sep 17 17:36:52.064527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064527 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-web" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064532 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-web" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064543 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="prom-label-proxy" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064548 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="prom-label-proxy" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064555 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="alertmanager" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064559 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="alertmanager" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064568 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="init-config-reloader" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064573 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="init-config-reloader" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064618 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-web" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064627 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy-metric" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064632 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="config-reloader" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064639 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3519099-f840-42c7-912d-8c7c29d282a2" containerName="registry" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064644 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="kube-rbac-proxy" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064650 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="alertmanager" Sep 17 17:36:52.064761 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.064654 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" containerName="prom-label-proxy" Sep 17 17:36:52.067776 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.067761 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.069784 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.069765 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:36:52.070617 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.070067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:36:52.070617 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.070213 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:36:52.070617 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.070352 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:36:52.070947 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.070721 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:36:52.071334 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.071035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6ljvx\"" Sep 17 17:36:52.071334 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.071034 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:36:52.071334 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.071287 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:36:52.071674 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.071651 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:36:52.075993 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.075974 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:36:52.089224 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.089204 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:36:52.158683 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.158798 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.158798 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-web-config\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.158798 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158753 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a976eea-cf2a-4632-ba41-aae27f80b9a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.158798 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a976eea-cf2a-4632-ba41-aae27f80b9a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tt6\" (UniqueName: \"kubernetes.io/projected/4a976eea-cf2a-4632-ba41-aae27f80b9a3-kube-api-access-p6tt6\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a976eea-cf2a-4632-ba41-aae27f80b9a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a976eea-cf2a-4632-ba41-aae27f80b9a3-config-out\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158976 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.159000 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.158993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a976eea-cf2a-4632-ba41-aae27f80b9a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.259960 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.259909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.259960 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.259941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a976eea-cf2a-4632-ba41-aae27f80b9a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.259960 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.259960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a976eea-cf2a-4632-ba41-aae27f80b9a3-config-out\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260110 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.259974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260147 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260147 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a976eea-cf2a-4632-ba41-aae27f80b9a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260295 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-web-config\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a976eea-cf2a-4632-ba41-aae27f80b9a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a976eea-cf2a-4632-ba41-aae27f80b9a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tt6\" (UniqueName: \"kubernetes.io/projected/4a976eea-cf2a-4632-ba41-aae27f80b9a3-kube-api-access-p6tt6\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260810 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a976eea-cf2a-4632-ba41-aae27f80b9a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.260810 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.260648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a976eea-cf2a-4632-ba41-aae27f80b9a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.261922 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.261866 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a976eea-cf2a-4632-ba41-aae27f80b9a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.262987 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.262957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.262987 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.262973 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.263231 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.263211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a976eea-cf2a-4632-ba41-aae27f80b9a3-config-out\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.263315 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.263299 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a976eea-cf2a-4632-ba41-aae27f80b9a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.263509 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.263488 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.263571 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.263513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.263632 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.263573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.264064 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.264039 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-web-config\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.264379 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.264364 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a976eea-cf2a-4632-ba41-aae27f80b9a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.268840 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.268822 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tt6\" (UniqueName: \"kubernetes.io/projected/4a976eea-cf2a-4632-ba41-aae27f80b9a3-kube-api-access-p6tt6\") pod \"alertmanager-main-0\" (UID: \"4a976eea-cf2a-4632-ba41-aae27f80b9a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.379084 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.379064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:36:52.658586 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:52.658491 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:36:52.661289 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:36:52.661262 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a976eea_cf2a_4632_ba41_aae27f80b9a3.slice/crio-3ac7b93e371959ff982634d0c8a54bbadeec80158028405667b9a3c404315ad0 WatchSource:0}: Error finding container 3ac7b93e371959ff982634d0c8a54bbadeec80158028405667b9a3c404315ad0: Status 404 returned error can't find the container with id 3ac7b93e371959ff982634d0c8a54bbadeec80158028405667b9a3c404315ad0 Sep 17 17:36:53.008125 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:53.008052 2580 generic.go:356] "Generic (PLEG): container finished" podID="4a976eea-cf2a-4632-ba41-aae27f80b9a3" containerID="10f196b71db509e12a91eaee98e31af39d054d2504d60081ab2aae7a2b99f3b5" exitCode=0 Sep 17 17:36:53.008244 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:53.008139 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerDied","Data":"10f196b71db509e12a91eaee98e31af39d054d2504d60081ab2aae7a2b99f3b5"} Sep 17 17:36:53.008244 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:53.008236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"3ac7b93e371959ff982634d0c8a54bbadeec80158028405667b9a3c404315ad0"} Sep 17 17:36:53.083030 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:53.083001 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="761d8f9b-ac2c-4a8f-bfdf-9d2295682981" path="/var/lib/kubelet/pods/761d8f9b-ac2c-4a8f-bfdf-9d2295682981/volumes" Sep 17 17:36:54.016770 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.016733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"0dedbca4d9e57c1535f1b160523db4704c6cace780f90d242c7c1a5eee1502f0"} Sep 17 17:36:54.017250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.016795 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"64eb5a4f103bba9e3c5e9b302e51ea969e7fb482bc6d601775d4020a345e8c55"} Sep 17 17:36:54.017250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.016822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"794110fcb5920725b2075b76ee6f8091c9c95247cda8ee8358d6d33ff61d4707"} Sep 17 17:36:54.017250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.016846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"8139b7d45797b9889d5a555443bbb22019d335b86e9e065c68ba0de3288a4ee2"} Sep 17 17:36:54.017250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.016868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"d31a3e6a822f8d260aabc34959167da87b6d930b1a717ee039055f0f1596f853"} Sep 17 17:36:54.017250 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.016891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a976eea-cf2a-4632-ba41-aae27f80b9a3","Type":"ContainerStarted","Data":"54346a1df6044ba595a0cb09243ce248351c036dbee6c09448712b41db260618"} Sep 17 17:36:54.043744 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:36:54.043692 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.030069999 podStartE2EDuration="2.043677512s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.607513ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:54.041987363 +0000 UTC m=+173.218381469" watchObservedRunningTime="2026-09-17 17:36:54.043677512 +0000 UTC m=+173.220071667" Sep 17 17:38:23.393564 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.393484 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g"] Sep 17 17:38:23.395739 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.395723 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.398601 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.398576 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kh5dr\"" Sep 17 17:38:23.398601 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.398591 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 17 17:38:23.399069 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.399054 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 17 17:38:23.405170 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.405148 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g"] Sep 17 17:38:23.488029 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.488010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.488160 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.488035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.488160 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.488056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x624j\" (UniqueName: \"kubernetes.io/projected/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-kube-api-access-x624j\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.589058 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.589035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.589178 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.589072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.589178 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.589098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x624j\" (UniqueName: \"kubernetes.io/projected/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-kube-api-access-x624j\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.589478 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.589456 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.589478 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.589470 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.598406 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.598380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x624j\" (UniqueName: \"kubernetes.io/projected/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-kube-api-access-x624j\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.704580 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.704524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:23.970268 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:23.970245 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g"] Sep 17 17:38:23.972929 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:38:23.972901 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab522c5_4402_4cdd_921e_36fc3d71a1a3.slice/crio-b91ce2d386adfbb6a1dc64b612396429e5145dea02dcfd09a7d1a1fe91b39d78 WatchSource:0}: Error finding container b91ce2d386adfbb6a1dc64b612396429e5145dea02dcfd09a7d1a1fe91b39d78: Status 404 returned error can't find the container with id b91ce2d386adfbb6a1dc64b612396429e5145dea02dcfd09a7d1a1fe91b39d78 Sep 17 17:38:24.365089 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:24.365056 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" event={"ID":"8ab522c5-4402-4cdd-921e-36fc3d71a1a3","Type":"ContainerStarted","Data":"b91ce2d386adfbb6a1dc64b612396429e5145dea02dcfd09a7d1a1fe91b39d78"} Sep 17 17:38:30.394748 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:30.394686 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerID="b69f72709cf4e7e1cf9ab86800089c39aa7e557d5719383cd1c52694d610b015" exitCode=0 Sep 17 17:38:30.395055 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:30.394770 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" event={"ID":"8ab522c5-4402-4cdd-921e-36fc3d71a1a3","Type":"ContainerDied","Data":"b69f72709cf4e7e1cf9ab86800089c39aa7e557d5719383cd1c52694d610b015"} Sep 17 17:38:32.405408 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:32.405360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" event={"ID":"8ab522c5-4402-4cdd-921e-36fc3d71a1a3","Type":"ContainerStarted","Data":"a3953e881065391b399daa5fc40a3601179045065183e10ef67fb5a889ee76dc"} Sep 17 17:38:33.411027 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:33.410985 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerID="a3953e881065391b399daa5fc40a3601179045065183e10ef67fb5a889ee76dc" exitCode=0 Sep 17 17:38:33.411460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:33.411038 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" event={"ID":"8ab522c5-4402-4cdd-921e-36fc3d71a1a3","Type":"ContainerDied","Data":"a3953e881065391b399daa5fc40a3601179045065183e10ef67fb5a889ee76dc"} Sep 17 17:38:40.443544 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:40.443517 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerID="85c7cf48fe4e55c1f579585e9f381bd52cc8661feac2e050fabde93f3d5b2fad" exitCode=0 Sep 17 17:38:40.443894 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:40.443594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" event={"ID":"8ab522c5-4402-4cdd-921e-36fc3d71a1a3","Type":"ContainerDied","Data":"85c7cf48fe4e55c1f579585e9f381bd52cc8661feac2e050fabde93f3d5b2fad"} Sep 17 17:38:41.572517 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.572493 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:41.735031 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.734960 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x624j\" (UniqueName: \"kubernetes.io/projected/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-kube-api-access-x624j\") pod \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " Sep 17 17:38:41.735031 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.734994 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-util\") pod \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " Sep 17 17:38:41.735215 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.735038 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-bundle\") pod \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\" (UID: \"8ab522c5-4402-4cdd-921e-36fc3d71a1a3\") " Sep 17 17:38:41.735712 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.735685 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-bundle" (OuterVolumeSpecName: "bundle") pod "8ab522c5-4402-4cdd-921e-36fc3d71a1a3" (UID: "8ab522c5-4402-4cdd-921e-36fc3d71a1a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:38:41.737047 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.737022 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-kube-api-access-x624j" (OuterVolumeSpecName: "kube-api-access-x624j") pod "8ab522c5-4402-4cdd-921e-36fc3d71a1a3" (UID: "8ab522c5-4402-4cdd-921e-36fc3d71a1a3"). InnerVolumeSpecName "kube-api-access-x624j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:41.740133 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.740111 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-util" (OuterVolumeSpecName: "util") pod "8ab522c5-4402-4cdd-921e-36fc3d71a1a3" (UID: "8ab522c5-4402-4cdd-921e-36fc3d71a1a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:38:41.835673 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.835651 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x624j\" (UniqueName: \"kubernetes.io/projected/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-kube-api-access-x624j\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:38:41.835673 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.835671 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-util\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:38:41.835802 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:41.835680 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab522c5-4402-4cdd-921e-36fc3d71a1a3-bundle\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:38:42.453918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:42.453887 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" Sep 17 17:38:42.453918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:42.453890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1av4c2g" event={"ID":"8ab522c5-4402-4cdd-921e-36fc3d71a1a3","Type":"ContainerDied","Data":"b91ce2d386adfbb6a1dc64b612396429e5145dea02dcfd09a7d1a1fe91b39d78"} Sep 17 17:38:42.454098 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:42.453941 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b91ce2d386adfbb6a1dc64b612396429e5145dea02dcfd09a7d1a1fe91b39d78" Sep 17 17:38:45.503598 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503568 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx"] Sep 17 17:38:45.503941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503873 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="extract" Sep 17 17:38:45.503941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503883 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="extract" Sep 17 17:38:45.503941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503896 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="util" Sep 17 17:38:45.503941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503901 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="util" Sep 17 17:38:45.503941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503915 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="pull" Sep 17 17:38:45.503941 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503920 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="pull" Sep 17 17:38:45.504132 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.503968 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab522c5-4402-4cdd-921e-36fc3d71a1a3" containerName="extract" Sep 17 17:38:45.537207 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.537183 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx"] Sep 17 17:38:45.537341 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.537267 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.539667 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.539648 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 17 17:38:45.539847 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.539832 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 17 17:38:45.539918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.539866 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 17 17:38:45.539918 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.539878 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-528sb\"" Sep 17 17:38:45.561167 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.561145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4jgx\" (UniqueName: \"kubernetes.io/projected/8fc358ad-de75-4700-8a15-f4eca0bbaca9-kube-api-access-z4jgx\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mxwgx\" (UID: \"8fc358ad-de75-4700-8a15-f4eca0bbaca9\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.561257 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.561210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8fc358ad-de75-4700-8a15-f4eca0bbaca9-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mxwgx\" (UID: \"8fc358ad-de75-4700-8a15-f4eca0bbaca9\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.661974 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.661943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8fc358ad-de75-4700-8a15-f4eca0bbaca9-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mxwgx\" (UID: \"8fc358ad-de75-4700-8a15-f4eca0bbaca9\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.662088 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.661991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4jgx\" (UniqueName: \"kubernetes.io/projected/8fc358ad-de75-4700-8a15-f4eca0bbaca9-kube-api-access-z4jgx\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mxwgx\" (UID: \"8fc358ad-de75-4700-8a15-f4eca0bbaca9\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.664117 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.664096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8fc358ad-de75-4700-8a15-f4eca0bbaca9-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mxwgx\" (UID: \"8fc358ad-de75-4700-8a15-f4eca0bbaca9\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.670495 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.670477 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4jgx\" (UniqueName: \"kubernetes.io/projected/8fc358ad-de75-4700-8a15-f4eca0bbaca9-kube-api-access-z4jgx\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mxwgx\" (UID: \"8fc358ad-de75-4700-8a15-f4eca0bbaca9\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:45.847281 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:45.847250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:46.156676 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:46.156574 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx"] Sep 17 17:38:46.158882 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:38:46.158855 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc358ad_de75_4700_8a15_f4eca0bbaca9.slice/crio-d0c49642cd2dcceefd178a06220e3e760baf603e7cd4ca0c9fcb52c14f809415 WatchSource:0}: Error finding container d0c49642cd2dcceefd178a06220e3e760baf603e7cd4ca0c9fcb52c14f809415: Status 404 returned error can't find the container with id d0c49642cd2dcceefd178a06220e3e760baf603e7cd4ca0c9fcb52c14f809415 Sep 17 17:38:46.470211 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:46.470145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" event={"ID":"8fc358ad-de75-4700-8a15-f4eca0bbaca9","Type":"ContainerStarted","Data":"d0c49642cd2dcceefd178a06220e3e760baf603e7cd4ca0c9fcb52c14f809415"} Sep 17 17:38:50.497894 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.497810 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" event={"ID":"8fc358ad-de75-4700-8a15-f4eca0bbaca9","Type":"ContainerStarted","Data":"09b5c8cfc8ca536c3243919f379d1c964aa2e9d0460c1dedfc3700187f8290e2"} Sep 17 17:38:50.498259 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.497926 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:38:50.521096 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.521056 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" podStartSLOduration=1.5486103249999998 podStartE2EDuration="5.521044165s" totalImagesPullingTime="3.97243384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:50.518872748 +0000 UTC m=+289.695266851" watchObservedRunningTime="2026-09-17 17:38:50.521044165 +0000 UTC m=+289.697438268" Sep 17 17:38:50.853314 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.851041 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-9lqrk"] Sep 17 17:38:50.876739 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.876710 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-9lqrk"] Sep 17 17:38:50.876877 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.876832 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.879223 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.879199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Sep 17 17:38:50.879501 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.879485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-x9mzg\"" Sep 17 17:38:50.879572 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.879486 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 17 17:38:50.896005 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.895986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-cabundle0\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.896095 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.896013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx5m9\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-kube-api-access-zx5m9\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.896095 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.896086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.996372 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.996347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.996503 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.996407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-cabundle0\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.996503 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.996428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx5m9\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-kube-api-access-zx5m9\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:50.996503 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:50.996486 2580 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Sep 17 17:38:50.996503 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:50.996503 2580 secret.go:281] references non-existent secret key: ca.crt Sep 17 17:38:50.996695 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:50.996511 2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 17 17:38:50.996695 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:50.996521 2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-9lqrk: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Sep 17 17:38:50.996695 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:50.996566 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates podName:c3d435f9-22c5-4a5f-8010-087f8ad8dc63 nodeName:}" failed. No retries permitted until 2026-09-17 17:38:51.496552358 +0000 UTC m=+290.672946441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates") pod "keda-operator-579c8958f7-9lqrk" (UID: "c3d435f9-22c5-4a5f-8010-087f8ad8dc63") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Sep 17 17:38:50.997114 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:50.997093 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-cabundle0\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:51.005972 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.005951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx5m9\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-kube-api-access-zx5m9\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:51.055120 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.055097 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg"] Sep 17 17:38:51.072858 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.072836 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg"] Sep 17 17:38:51.072953 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.072938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.075156 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.075129 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Sep 17 17:38:51.096850 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.096827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.096959 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.096912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s6hm\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-kube-api-access-6s6hm\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.097044 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.096970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b7916cdc-eece-4601-8a0d-7cc9f793fc67-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.198007 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.197945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.198099 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.198023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6hm\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-kube-api-access-6s6hm\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.198099 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.198091 2580 secret.go:281] references non-existent secret key: tls.crt Sep 17 17:38:51.198204 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.198111 2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Sep 17 17:38:51.198204 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.198130 2580 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Sep 17 17:38:51.198204 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.198149 2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Sep 17 17:38:51.198204 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.198188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b7916cdc-eece-4601-8a0d-7cc9f793fc67-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.198427 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.198210 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-certificates podName:b7916cdc-eece-4601-8a0d-7cc9f793fc67 nodeName:}" failed. No retries permitted until 2026-09-17 17:38:51.69819369 +0000 UTC m=+290.874587782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-certificates") pod "keda-metrics-apiserver-77857b7b98-n7fcg" (UID: "b7916cdc-eece-4601-8a0d-7cc9f793fc67") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Sep 17 17:38:51.198541 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.198524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b7916cdc-eece-4601-8a0d-7cc9f793fc67-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.209713 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.209694 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s6hm\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-kube-api-access-6s6hm\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.499839 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.499771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:51.500232 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.499872 2580 secret.go:281] references non-existent secret key: ca.crt Sep 17 17:38:51.500232 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.499884 2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 17 17:38:51.500232 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.499891 2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-9lqrk: references non-existent secret key: ca.crt Sep 17 17:38:51.500232 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:38:51.499938 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates podName:c3d435f9-22c5-4a5f-8010-087f8ad8dc63 nodeName:}" failed. No retries permitted until 2026-09-17 17:38:52.49992197 +0000 UTC m=+291.676316056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates") pod "keda-operator-579c8958f7-9lqrk" (UID: "c3d435f9-22c5-4a5f-8010-087f8ad8dc63") : references non-existent secret key: ca.crt Sep 17 17:38:51.701389 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.701355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.703980 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.703958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b7916cdc-eece-4601-8a0d-7cc9f793fc67-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n7fcg\" (UID: \"b7916cdc-eece-4601-8a0d-7cc9f793fc67\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:51.759947 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.759895 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-nct7j"] Sep 17 17:38:51.780022 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.780003 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-nct7j"] Sep 17 17:38:51.780131 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.780088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.782308 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.782286 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Sep 17 17:38:51.802481 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.802455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/89af5383-1634-4fa9-bdb8-50326c98e163-certificates\") pod \"keda-admission-6c4d864b86-nct7j\" (UID: \"89af5383-1634-4fa9-bdb8-50326c98e163\") " pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.802627 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.802501 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvxj\" (UniqueName: \"kubernetes.io/projected/89af5383-1634-4fa9-bdb8-50326c98e163-kube-api-access-ztvxj\") pod \"keda-admission-6c4d864b86-nct7j\" (UID: \"89af5383-1634-4fa9-bdb8-50326c98e163\") " pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.903206 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.903179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/89af5383-1634-4fa9-bdb8-50326c98e163-certificates\") pod \"keda-admission-6c4d864b86-nct7j\" (UID: \"89af5383-1634-4fa9-bdb8-50326c98e163\") " pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.903362 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.903213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvxj\" (UniqueName: \"kubernetes.io/projected/89af5383-1634-4fa9-bdb8-50326c98e163-kube-api-access-ztvxj\") pod \"keda-admission-6c4d864b86-nct7j\" (UID: \"89af5383-1634-4fa9-bdb8-50326c98e163\") " pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.905815 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.905789 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/89af5383-1634-4fa9-bdb8-50326c98e163-certificates\") pod \"keda-admission-6c4d864b86-nct7j\" (UID: \"89af5383-1634-4fa9-bdb8-50326c98e163\") " pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.913078 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.913058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvxj\" (UniqueName: \"kubernetes.io/projected/89af5383-1634-4fa9-bdb8-50326c98e163-kube-api-access-ztvxj\") pod \"keda-admission-6c4d864b86-nct7j\" (UID: \"89af5383-1634-4fa9-bdb8-50326c98e163\") " pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:51.986640 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:51.986613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:52.091288 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.091223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:52.280845 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.280771 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg"] Sep 17 17:38:52.285257 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:38:52.285231 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7916cdc_eece_4601_8a0d_7cc9f793fc67.slice/crio-67f19aae816857ea72c9dc55a0c7a4d886fc28f1877198974c5da9d023dfb93f WatchSource:0}: Error finding container 67f19aae816857ea72c9dc55a0c7a4d886fc28f1877198974c5da9d023dfb93f: Status 404 returned error can't find the container with id 67f19aae816857ea72c9dc55a0c7a4d886fc28f1877198974c5da9d023dfb93f Sep 17 17:38:52.388309 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.388254 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-nct7j"] Sep 17 17:38:52.390243 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:38:52.390220 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89af5383_1634_4fa9_bdb8_50326c98e163.slice/crio-5a323dc9bc169385d4d7b0432cbb97381f134f90d7c09b2dde27300022796899 WatchSource:0}: Error finding container 5a323dc9bc169385d4d7b0432cbb97381f134f90d7c09b2dde27300022796899: Status 404 returned error can't find the container with id 5a323dc9bc169385d4d7b0432cbb97381f134f90d7c09b2dde27300022796899 Sep 17 17:38:52.506989 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.506963 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:52.508292 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.508261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" event={"ID":"b7916cdc-eece-4601-8a0d-7cc9f793fc67","Type":"ContainerStarted","Data":"67f19aae816857ea72c9dc55a0c7a4d886fc28f1877198974c5da9d023dfb93f"} Sep 17 17:38:52.509530 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.509505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" event={"ID":"89af5383-1634-4fa9-bdb8-50326c98e163","Type":"ContainerStarted","Data":"5a323dc9bc169385d4d7b0432cbb97381f134f90d7c09b2dde27300022796899"} Sep 17 17:38:52.509642 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.509559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3d435f9-22c5-4a5f-8010-087f8ad8dc63-certificates\") pod \"keda-operator-579c8958f7-9lqrk\" (UID: \"c3d435f9-22c5-4a5f-8010-087f8ad8dc63\") " pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:52.687476 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.687452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:52.955792 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:52.955602 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-9lqrk"] Sep 17 17:38:52.958099 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:38:52.958074 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d435f9_22c5_4a5f_8010_087f8ad8dc63.slice/crio-b88f57bb425545aa46358cd076030a06b1834ed7807e3b465a55527599a5f27d WatchSource:0}: Error finding container b88f57bb425545aa46358cd076030a06b1834ed7807e3b465a55527599a5f27d: Status 404 returned error can't find the container with id b88f57bb425545aa46358cd076030a06b1834ed7807e3b465a55527599a5f27d Sep 17 17:38:53.516248 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:53.516195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" event={"ID":"c3d435f9-22c5-4a5f-8010-087f8ad8dc63","Type":"ContainerStarted","Data":"b88f57bb425545aa46358cd076030a06b1834ed7807e3b465a55527599a5f27d"} Sep 17 17:38:55.528458 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:55.528360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" event={"ID":"89af5383-1634-4fa9-bdb8-50326c98e163","Type":"ContainerStarted","Data":"a71f58b92cf88cb35acada770855a2b3bc7021e7e14be33c365ffbd37fa7a806"} Sep 17 17:38:55.528897 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:55.528469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:38:55.545097 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:55.545046 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" podStartSLOduration=1.6649964160000001 podStartE2EDuration="4.545027512s" totalImagesPullingTime="2.880031096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:55.543533559 +0000 UTC m=+294.719927676" watchObservedRunningTime="2026-09-17 17:38:55.545027512 +0000 UTC m=+294.721421616" Sep 17 17:38:57.539725 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:57.539686 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" event={"ID":"c3d435f9-22c5-4a5f-8010-087f8ad8dc63","Type":"ContainerStarted","Data":"e85755e06658b88e997a081c07105f48eaf6442caae721c7ca772c47007a45d5"} Sep 17 17:38:57.540123 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:57.539752 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:38:57.541254 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:57.541233 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" event={"ID":"b7916cdc-eece-4601-8a0d-7cc9f793fc67","Type":"ContainerStarted","Data":"b5640c3909ef254ed268a9a5953727eda46abd6501a396fa2f5381ebecb8d461"} Sep 17 17:38:57.541368 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:57.541348 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:38:57.557124 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:57.557085 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" podStartSLOduration=3.303328211 podStartE2EDuration="7.557071986s" totalImagesPullingTime="4.253743775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:57.555031823 +0000 UTC m=+296.731425927" watchObservedRunningTime="2026-09-17 17:38:57.557071986 +0000 UTC m=+296.733466145" Sep 17 17:38:57.571432 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:38:57.571370 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" podStartSLOduration=1.648440864 podStartE2EDuration="6.571353755s" totalImagesPullingTime="4.922912891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:57.569957851 +0000 UTC m=+296.746351955" watchObservedRunningTime="2026-09-17 17:38:57.571353755 +0000 UTC m=+296.747747863" Sep 17 17:39:02.940788 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:02.940761 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:39:02.942594 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:02.942575 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:39:02.949170 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:02.949151 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:39:02.951106 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:02.951083 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:39:02.952794 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:02.952776 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 17:39:08.551432 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:08.551392 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n7fcg" Sep 17 17:39:11.504351 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:11.504321 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mxwgx" Sep 17 17:39:16.536527 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:16.536496 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-nct7j" Sep 17 17:39:18.548386 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:39:18.548361 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-9lqrk" Sep 17 17:40:06.671224 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.671192 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-pwkdp"] Sep 17 17:40:06.673567 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.673549 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.675734 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.675713 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 17:40:06.676454 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.676437 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-kjbd5\"" Sep 17 17:40:06.676564 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.676436 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 17:40:06.676564 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.676436 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 17:40:06.681846 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.681827 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-pwkdp"] Sep 17 17:40:06.859841 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.859812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bd738959-96b0-474d-948c-6debe58b0449-data\") pod \"seaweedfs-64568bcd49-pwkdp\" (UID: \"bd738959-96b0-474d-948c-6debe58b0449\") " pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.859996 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.859859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4r9x\" (UniqueName: \"kubernetes.io/projected/bd738959-96b0-474d-948c-6debe58b0449-kube-api-access-t4r9x\") pod \"seaweedfs-64568bcd49-pwkdp\" (UID: \"bd738959-96b0-474d-948c-6debe58b0449\") " pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.960273 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.960201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bd738959-96b0-474d-948c-6debe58b0449-data\") pod \"seaweedfs-64568bcd49-pwkdp\" (UID: \"bd738959-96b0-474d-948c-6debe58b0449\") " pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.960273 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.960263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4r9x\" (UniqueName: \"kubernetes.io/projected/bd738959-96b0-474d-948c-6debe58b0449-kube-api-access-t4r9x\") pod \"seaweedfs-64568bcd49-pwkdp\" (UID: \"bd738959-96b0-474d-948c-6debe58b0449\") " pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.960562 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.960544 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bd738959-96b0-474d-948c-6debe58b0449-data\") pod \"seaweedfs-64568bcd49-pwkdp\" (UID: \"bd738959-96b0-474d-948c-6debe58b0449\") " pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.970237 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.970209 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4r9x\" (UniqueName: \"kubernetes.io/projected/bd738959-96b0-474d-948c-6debe58b0449-kube-api-access-t4r9x\") pod \"seaweedfs-64568bcd49-pwkdp\" (UID: \"bd738959-96b0-474d-948c-6debe58b0449\") " pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:06.983069 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:06.983050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:07.254983 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:07.254920 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-pwkdp"] Sep 17 17:40:07.258249 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:40:07.258227 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd738959_96b0_474d_948c_6debe58b0449.slice/crio-cb51b21f0c7e12c22a029f8def2167091cc4a65ea5e8a0bc26bcc7570d295ea6 WatchSource:0}: Error finding container cb51b21f0c7e12c22a029f8def2167091cc4a65ea5e8a0bc26bcc7570d295ea6: Status 404 returned error can't find the container with id cb51b21f0c7e12c22a029f8def2167091cc4a65ea5e8a0bc26bcc7570d295ea6 Sep 17 17:40:07.259554 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:07.259539 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:40:07.856376 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:07.856345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-pwkdp" event={"ID":"bd738959-96b0-474d-948c-6debe58b0449","Type":"ContainerStarted","Data":"cb51b21f0c7e12c22a029f8def2167091cc4a65ea5e8a0bc26bcc7570d295ea6"} Sep 17 17:40:10.872991 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:10.872954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-pwkdp" event={"ID":"bd738959-96b0-474d-948c-6debe58b0449","Type":"ContainerStarted","Data":"d5734ed05b8415dd65b8037d9cd15c6fcdb6d6200c0d7996189ab02eb1e348df"} Sep 17 17:40:10.873334 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:10.873027 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:40:10.888026 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:10.887953 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-pwkdp" podStartSLOduration=2.0497303159999998 podStartE2EDuration="4.887934878s" totalImagesPullingTime="2.838204562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:40:10.887275424 +0000 UTC m=+370.063669528" watchObservedRunningTime="2026-09-17 17:40:10.887934878 +0000 UTC m=+370.064328982" Sep 17 17:40:16.879415 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:40:16.879370 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-pwkdp" Sep 17 17:41:23.676166 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.676096 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-sgwkg"] Sep 17 17:41:23.679229 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.679204 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:23.681456 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.681434 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-zwkv6\"" Sep 17 17:41:23.681589 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.681477 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Sep 17 17:41:23.689076 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.689040 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-sgwkg"] Sep 17 17:41:23.692355 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.692336 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-hdmmm"] Sep 17 17:41:23.695590 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.695574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.697690 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.697673 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Sep 17 17:41:23.697814 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.697690 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-tfk6g\"" Sep 17 17:41:23.697925 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.697722 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\"" Sep 17 17:41:23.708057 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.708038 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-hdmmm"] Sep 17 17:41:23.813011 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.812986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsxc9\" (UniqueName: \"kubernetes.io/projected/6baed8cd-4962-4fac-b604-be4167c5b221-kube-api-access-dsxc9\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:23.813105 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.813021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6baed8cd-4962-4fac-b604-be4167c5b221-tls-certs\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:23.813105 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.813037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzm7l\" (UniqueName: \"kubernetes.io/projected/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-kube-api-access-zzm7l\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.813105 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.813070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-cert\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.813223 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.813104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-metrics-certs\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.914247 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.914219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6baed8cd-4962-4fac-b604-be4167c5b221-tls-certs\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:23.914321 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.914250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzm7l\" (UniqueName: \"kubernetes.io/projected/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-kube-api-access-zzm7l\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.914321 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.914273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-cert\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.914321 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.914296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-metrics-certs\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.914466 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.914371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsxc9\" (UniqueName: \"kubernetes.io/projected/6baed8cd-4962-4fac-b604-be4167c5b221-kube-api-access-dsxc9\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:23.914507 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:41:23.914471 2580 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 17 17:41:23.914561 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:41:23.914549 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6baed8cd-4962-4fac-b604-be4167c5b221-tls-certs podName:6baed8cd-4962-4fac-b604-be4167c5b221 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:24.414528977 +0000 UTC m=+443.590923059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6baed8cd-4962-4fac-b604-be4167c5b221-tls-certs") pod "model-serving-api-7b954ffc95-sgwkg" (UID: "6baed8cd-4962-4fac-b604-be4167c5b221") : secret "model-serving-api-tls" not found Sep 17 17:41:23.916652 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.916627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-metrics-certs\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.916652 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.916645 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-cert\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:23.924651 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.924627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsxc9\" (UniqueName: \"kubernetes.io/projected/6baed8cd-4962-4fac-b604-be4167c5b221-kube-api-access-dsxc9\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:23.924750 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:23.924683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzm7l\" (UniqueName: \"kubernetes.io/projected/2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27-kube-api-access-zzm7l\") pod \"odh-model-controller-7b966d7984-hdmmm\" (UID: \"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27\") " pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:24.008261 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:24.008196 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:24.280532 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:24.280418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-hdmmm"] Sep 17 17:41:24.283651 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:41:24.283626 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecb73a7_6d15_4b22_9ea1_14e2ae2d6f27.slice/crio-8cea7290da823e19d06c2ba614cd4f5a589cc5158a1a68401f1c604a3db05593 WatchSource:0}: Error finding container 8cea7290da823e19d06c2ba614cd4f5a589cc5158a1a68401f1c604a3db05593: Status 404 returned error can't find the container with id 8cea7290da823e19d06c2ba614cd4f5a589cc5158a1a68401f1c604a3db05593 Sep 17 17:41:24.418575 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:24.418545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6baed8cd-4962-4fac-b604-be4167c5b221-tls-certs\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:24.420932 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:24.420909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6baed8cd-4962-4fac-b604-be4167c5b221-tls-certs\") pod \"model-serving-api-7b954ffc95-sgwkg\" (UID: \"6baed8cd-4962-4fac-b604-be4167c5b221\") " pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:24.592666 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:24.592642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:24.862451 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:24.862363 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-sgwkg"] Sep 17 17:41:24.866276 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:41:24.866234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baed8cd_4962_4fac_b604_be4167c5b221.slice/crio-b6f148834760692f570640f3cd7586883dc9c29bf0785943bf0994612cd09b39 WatchSource:0}: Error finding container b6f148834760692f570640f3cd7586883dc9c29bf0785943bf0994612cd09b39: Status 404 returned error can't find the container with id b6f148834760692f570640f3cd7586883dc9c29bf0785943bf0994612cd09b39 Sep 17 17:41:25.208932 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:25.208853 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-hdmmm" event={"ID":"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27","Type":"ContainerStarted","Data":"8cea7290da823e19d06c2ba614cd4f5a589cc5158a1a68401f1c604a3db05593"} Sep 17 17:41:25.209957 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:25.209935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-sgwkg" event={"ID":"6baed8cd-4962-4fac-b604-be4167c5b221","Type":"ContainerStarted","Data":"b6f148834760692f570640f3cd7586883dc9c29bf0785943bf0994612cd09b39"} Sep 17 17:41:28.227193 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:28.227157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-hdmmm" event={"ID":"2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27","Type":"ContainerStarted","Data":"d1f4856a1083e694896e84ecebcf4091164e44ec0f5ef6bfc043dbeda6aef38d"} Sep 17 17:41:28.227597 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:28.227265 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:28.228693 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:28.228668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-sgwkg" event={"ID":"6baed8cd-4962-4fac-b604-be4167c5b221","Type":"ContainerStarted","Data":"aaa969d491824c916abdc5e407046ed6ee0c528faa8778356bcfdfa5b96ca6b6"} Sep 17 17:41:28.228791 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:28.228778 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:41:28.243274 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:28.243203 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-hdmmm" podStartSLOduration=1.535684039 podStartE2EDuration="5.243191422s" totalImagesPullingTime="3.707507383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:28.242204361 +0000 UTC m=+447.418598487" watchObservedRunningTime="2026-09-17 17:41:28.243191422 +0000 UTC m=+447.419585517" Sep 17 17:41:28.258253 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:28.258212 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-sgwkg" podStartSLOduration=2.093972308 podStartE2EDuration="5.258199524s" totalImagesPullingTime="3.164227216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:28.257615462 +0000 UTC m=+447.434009567" watchObservedRunningTime="2026-09-17 17:41:28.258199524 +0000 UTC m=+447.434593628" Sep 17 17:41:39.234500 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:39.234468 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-hdmmm" Sep 17 17:41:39.237211 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:41:39.237180 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-sgwkg" Sep 17 17:44:02.973890 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:44:02.973863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:44:02.974429 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:44:02.974233 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:44:02.980859 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:44:02.980836 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:44:02.980979 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:44:02.980921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:46:35.878375 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.878346 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4"] Sep 17 17:46:35.881709 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.881693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:35.883722 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.883696 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cm7p9\"" Sep 17 17:46:35.883954 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.883937 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-636c4-serving-cert\"" Sep 17 17:46:35.884014 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.883938 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-636c4-kube-rbac-proxy-sar-config\"" Sep 17 17:46:35.884014 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.883964 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 17:46:35.889605 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.889585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4"] Sep 17 17:46:35.958293 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.958271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:35.958374 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:35.958304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d905f9e1-d384-4d17-af4a-b5c3396ece4d-openshift-service-ca-bundle\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:36.059560 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:36.059542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:36.059663 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:36.059572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d905f9e1-d384-4d17-af4a-b5c3396ece4d-openshift-service-ca-bundle\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:36.059777 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:46:36.059684 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-636c4-serving-cert: secret "model-chainer-raw-636c4-serving-cert" not found Sep 17 17:46:36.059777 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:46:36.059766 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls podName:d905f9e1-d384-4d17-af4a-b5c3396ece4d nodeName:}" failed. No retries permitted until 2026-09-17 17:46:36.559744924 +0000 UTC m=+755.736139012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls") pod "model-chainer-raw-636c4-f57976cc9-qjvf4" (UID: "d905f9e1-d384-4d17-af4a-b5c3396ece4d") : secret "model-chainer-raw-636c4-serving-cert" not found Sep 17 17:46:36.060088 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:36.060071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d905f9e1-d384-4d17-af4a-b5c3396ece4d-openshift-service-ca-bundle\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:36.562240 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:36.562211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:36.564679 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:36.564654 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls\") pod \"model-chainer-raw-636c4-f57976cc9-qjvf4\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:36.792490 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:36.792470 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:37.062794 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:37.062770 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4"] Sep 17 17:46:37.065079 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:46:37.065050 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd905f9e1_d384_4d17_af4a_b5c3396ece4d.slice/crio-474b48eb5f82da3988d8d1ac98efd4be2ad7251018743f010e3ac194ba58caec WatchSource:0}: Error finding container 474b48eb5f82da3988d8d1ac98efd4be2ad7251018743f010e3ac194ba58caec: Status 404 returned error can't find the container with id 474b48eb5f82da3988d8d1ac98efd4be2ad7251018743f010e3ac194ba58caec Sep 17 17:46:37.067158 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:37.067140 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:46:37.615720 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:37.615667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" event={"ID":"d905f9e1-d384-4d17-af4a-b5c3396ece4d","Type":"ContainerStarted","Data":"474b48eb5f82da3988d8d1ac98efd4be2ad7251018743f010e3ac194ba58caec"} Sep 17 17:46:39.634419 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:39.634362 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" event={"ID":"d905f9e1-d384-4d17-af4a-b5c3396ece4d","Type":"ContainerStarted","Data":"0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa"} Sep 17 17:46:39.634760 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:39.634458 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:39.652433 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:39.652364 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podStartSLOduration=2.543000755 podStartE2EDuration="4.652349054s" totalImagesPullingTime="2.109348299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:46:39.652321263 +0000 UTC m=+758.828715366" watchObservedRunningTime="2026-09-17 17:46:39.652349054 +0000 UTC m=+758.828743157" Sep 17 17:46:45.644311 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:45.644279 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:46:45.921849 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:45.921771 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4"] Sep 17 17:46:45.921997 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:45.921961 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" containerID="cri-o://0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa" gracePeriod=30 Sep 17 17:46:50.642989 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:50.642940 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:46:55.643439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:46:55.643385 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:47:00.643172 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:00.643125 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:47:00.643668 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:00.643233 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:47:05.643372 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:05.643330 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:47:10.642700 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:10.642654 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:47:15.643054 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:15.642970 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:47:16.055897 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.055867 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:47:16.136351 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.136323 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls\") pod \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " Sep 17 17:47:16.136510 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.136422 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d905f9e1-d384-4d17-af4a-b5c3396ece4d-openshift-service-ca-bundle\") pod \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\" (UID: \"d905f9e1-d384-4d17-af4a-b5c3396ece4d\") " Sep 17 17:47:16.136964 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.136926 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d905f9e1-d384-4d17-af4a-b5c3396ece4d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d905f9e1-d384-4d17-af4a-b5c3396ece4d" (UID: "d905f9e1-d384-4d17-af4a-b5c3396ece4d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:47:16.143330 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.143296 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d905f9e1-d384-4d17-af4a-b5c3396ece4d" (UID: "d905f9e1-d384-4d17-af4a-b5c3396ece4d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:47:16.237826 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.237776 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d905f9e1-d384-4d17-af4a-b5c3396ece4d-proxy-tls\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:47:16.237826 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.237799 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d905f9e1-d384-4d17-af4a-b5c3396ece4d-openshift-service-ca-bundle\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:47:16.811569 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.811535 2580 generic.go:356] "Generic (PLEG): container finished" podID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerID="0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa" exitCode=0 Sep 17 17:47:16.811998 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.811588 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" event={"ID":"d905f9e1-d384-4d17-af4a-b5c3396ece4d","Type":"ContainerDied","Data":"0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa"} Sep 17 17:47:16.811998 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.811650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" event={"ID":"d905f9e1-d384-4d17-af4a-b5c3396ece4d","Type":"ContainerDied","Data":"474b48eb5f82da3988d8d1ac98efd4be2ad7251018743f010e3ac194ba58caec"} Sep 17 17:47:16.811998 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.811589 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4" Sep 17 17:47:16.811998 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.811671 2580 scope.go:117] "RemoveContainer" containerID="0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa" Sep 17 17:47:16.820606 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.820585 2580 scope.go:117] "RemoveContainer" containerID="0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa" Sep 17 17:47:16.820853 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:47:16.820833 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa\": container with ID starting with 0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa not found: ID does not exist" containerID="0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa" Sep 17 17:47:16.820912 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.820864 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa"} err="failed to get container status \"0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa\": rpc error: code = NotFound desc = could not find container \"0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa\": container with ID starting with 0c1574116a0380e1c48f01872f4831566f33cc5701522b3a30617f6a9a3373aa not found: ID does not exist" Sep 17 17:47:16.834033 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.834012 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4"] Sep 17 17:47:16.840518 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:16.840500 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-636c4-f57976cc9-qjvf4"] Sep 17 17:47:17.083432 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:47:17.083368 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" path="/var/lib/kubelet/pods/d905f9e1-d384-4d17-af4a-b5c3396ece4d/volumes" Sep 17 17:48:26.194368 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.194335 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj"] Sep 17 17:48:26.194763 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.194709 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" Sep 17 17:48:26.194763 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.194721 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" Sep 17 17:48:26.194832 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.194778 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d905f9e1-d384-4d17-af4a-b5c3396ece4d" containerName="model-chainer-raw-636c4" Sep 17 17:48:26.197638 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.197623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.200030 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.200008 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-51535-kube-rbac-proxy-sar-config\"" Sep 17 17:48:26.200178 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.200015 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-51535-serving-cert\"" Sep 17 17:48:26.200608 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.200589 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 17:48:26.200709 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.200595 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cm7p9\"" Sep 17 17:48:26.213424 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.212265 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj"] Sep 17 17:48:26.349147 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.349113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c96dc-1b18-4654-a8bd-1290de36c199-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.349307 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.349220 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c5c96dc-1b18-4654-a8bd-1290de36c199-proxy-tls\") pod \"model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.449980 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.449911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c5c96dc-1b18-4654-a8bd-1290de36c199-proxy-tls\") pod \"model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.449980 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.449959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c96dc-1b18-4654-a8bd-1290de36c199-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.450583 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.450565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c96dc-1b18-4654-a8bd-1290de36c199-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.452199 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.452180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c5c96dc-1b18-4654-a8bd-1290de36c199-proxy-tls\") pod \"model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.510023 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.509999 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:26.778579 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:26.778554 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj"] Sep 17 17:48:26.780588 ip-10-0-132-90 kubenswrapper[2580]: W0917 17:48:26.780561 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5c96dc_1b18_4654_a8bd_1290de36c199.slice/crio-7b486053465294bcbe98bad8fb5124df8af16af361b3b9fab92358c834110e31 WatchSource:0}: Error finding container 7b486053465294bcbe98bad8fb5124df8af16af361b3b9fab92358c834110e31: Status 404 returned error can't find the container with id 7b486053465294bcbe98bad8fb5124df8af16af361b3b9fab92358c834110e31 Sep 17 17:48:27.119547 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:27.119512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" event={"ID":"0c5c96dc-1b18-4654-a8bd-1290de36c199","Type":"ContainerStarted","Data":"f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a"} Sep 17 17:48:27.119698 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:27.119564 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" event={"ID":"0c5c96dc-1b18-4654-a8bd-1290de36c199","Type":"ContainerStarted","Data":"7b486053465294bcbe98bad8fb5124df8af16af361b3b9fab92358c834110e31"} Sep 17 17:48:27.119698 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:27.119643 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:27.142710 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:27.142670 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podStartSLOduration=1.142656307 podStartE2EDuration="1.142656307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:27.142442096 +0000 UTC m=+866.318836200" watchObservedRunningTime="2026-09-17 17:48:27.142656307 +0000 UTC m=+866.319050410" Sep 17 17:48:33.128723 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:33.128700 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:36.301078 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:36.301044 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj"] Sep 17 17:48:36.301554 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:36.301212 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" containerID="cri-o://f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a" gracePeriod=30 Sep 17 17:48:38.128412 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:38.128373 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:48:43.127998 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:43.127962 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:48:48.127309 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:48.127231 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:48:48.127730 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:48.127329 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:48:53.128032 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:53.127995 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:48:58.128227 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:48:58.128185 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:49:03.003704 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:03.003670 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:49:03.005381 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:03.005359 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:49:03.010750 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:03.010728 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:49:03.012164 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:03.012146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:49:03.127894 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:03.127867 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:49:06.442325 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.442302 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:49:06.558433 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.558352 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c96dc-1b18-4654-a8bd-1290de36c199-openshift-service-ca-bundle\") pod \"0c5c96dc-1b18-4654-a8bd-1290de36c199\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " Sep 17 17:49:06.558549 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.558461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c5c96dc-1b18-4654-a8bd-1290de36c199-proxy-tls\") pod \"0c5c96dc-1b18-4654-a8bd-1290de36c199\" (UID: \"0c5c96dc-1b18-4654-a8bd-1290de36c199\") " Sep 17 17:49:06.558739 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.558713 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5c96dc-1b18-4654-a8bd-1290de36c199-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0c5c96dc-1b18-4654-a8bd-1290de36c199" (UID: "0c5c96dc-1b18-4654-a8bd-1290de36c199"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:06.560306 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.560283 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5c96dc-1b18-4654-a8bd-1290de36c199-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0c5c96dc-1b18-4654-a8bd-1290de36c199" (UID: "0c5c96dc-1b18-4654-a8bd-1290de36c199"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:49:06.659228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.659206 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c5c96dc-1b18-4654-a8bd-1290de36c199-proxy-tls\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:49:06.659228 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:06.659228 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c96dc-1b18-4654-a8bd-1290de36c199-openshift-service-ca-bundle\") on node \"ip-10-0-132-90.ec2.internal\" DevicePath \"\"" Sep 17 17:49:07.293302 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.293275 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerID="f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a" exitCode=0 Sep 17 17:49:07.293460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.293316 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" Sep 17 17:49:07.293460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.293355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" event={"ID":"0c5c96dc-1b18-4654-a8bd-1290de36c199","Type":"ContainerDied","Data":"f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a"} Sep 17 17:49:07.293460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.293412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj" event={"ID":"0c5c96dc-1b18-4654-a8bd-1290de36c199","Type":"ContainerDied","Data":"7b486053465294bcbe98bad8fb5124df8af16af361b3b9fab92358c834110e31"} Sep 17 17:49:07.293460 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.293434 2580 scope.go:117] "RemoveContainer" containerID="f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a" Sep 17 17:49:07.301422 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.301390 2580 scope.go:117] "RemoveContainer" containerID="f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a" Sep 17 17:49:07.301667 ip-10-0-132-90 kubenswrapper[2580]: E0917 17:49:07.301649 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a\": container with ID starting with f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a not found: ID does not exist" containerID="f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a" Sep 17 17:49:07.301740 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.301673 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a"} err="failed to get container status \"f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a\": rpc error: code = NotFound desc = could not find container \"f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a\": container with ID starting with f4b7fb8974723458cbe5675e116f7d0c4af721e04cd38de5bb1a19cac9b0b91a not found: ID does not exist" Sep 17 17:49:07.310463 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.310439 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj"] Sep 17 17:49:07.319019 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:07.318982 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-51535-8dcf5d4c4-jn8lj"] Sep 17 17:49:09.082439 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:49:09.082389 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" path="/var/lib/kubelet/pods/0c5c96dc-1b18-4654-a8bd-1290de36c199/volumes" Sep 17 17:54:03.033649 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:54:03.033621 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:54:03.035635 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:54:03.035610 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:54:03.040682 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:54:03.040661 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:54:03.042497 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:54:03.042477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:59:03.061935 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:59:03.061902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:59:03.065131 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:59:03.065109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 17:59:03.068705 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:59:03.068682 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 17:59:03.071763 ip-10-0-132-90 kubenswrapper[2580]: I0917 17:59:03.071744 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 18:00:26.821361 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:26.821329 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-scddx_26e0676b-b698-4df9-95a3-0073b021ce55/global-pull-secret-syncer/0.log" Sep 17 18:00:26.989056 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:26.989029 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h6fzd_6fd9648a-85f9-4872-9769-1de2af2258cc/konnectivity-agent/0.log" Sep 17 18:00:27.014379 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:27.014356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-90.ec2.internal_970278068a61198f811d4e0e33bb9518/haproxy/0.log" Sep 17 18:00:30.820277 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:30.820235 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/alertmanager/0.log" Sep 17 18:00:30.848765 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:30.848740 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/config-reloader/0.log" Sep 17 18:00:30.873813 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:30.873786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/kube-rbac-proxy-web/0.log" Sep 17 18:00:30.901974 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:30.901948 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/kube-rbac-proxy/0.log" Sep 17 18:00:30.951977 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:30.951956 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/kube-rbac-proxy-metric/0.log" Sep 17 18:00:30.975591 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:30.975571 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/prom-label-proxy/0.log" Sep 17 18:00:31.010355 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.010338 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a976eea-cf2a-4632-ba41-aae27f80b9a3/init-config-reloader/0.log" Sep 17 18:00:31.265126 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.265046 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-5dw4q_9763d7e1-c7ed-4af6-a2ce-93a718fe6616/monitoring-plugin/0.log" Sep 17 18:00:31.297821 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.297793 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mczh2_fe05b634-011f-414c-820f-2418ee7ec55c/node-exporter/0.log" Sep 17 18:00:31.319958 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.319937 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mczh2_fe05b634-011f-414c-820f-2418ee7ec55c/kube-rbac-proxy/0.log" Sep 17 18:00:31.346211 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.346196 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mczh2_fe05b634-011f-414c-820f-2418ee7ec55c/init-textfile/0.log" Sep 17 18:00:31.942306 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.942274 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-fvztl_7e6f0e5b-6302-43d4-8ed4-4be937b12d8f/prometheus-operator/0.log" Sep 17 18:00:31.961699 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.961677 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-fvztl_7e6f0e5b-6302-43d4-8ed4-4be937b12d8f/kube-rbac-proxy/0.log" Sep 17 18:00:31.987763 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:31.987725 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-s5v42_19b477c3-a650-4576-90f3-ea94355a45f2/prometheus-operator-admission-webhook/0.log" Sep 17 18:00:32.033129 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.033101 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69bd7cbbd6-p49lc_1369f48c-bbe7-48e8-866c-4c6f2c8db14b/telemeter-client/0.log" Sep 17 18:00:32.059640 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.059624 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69bd7cbbd6-p49lc_1369f48c-bbe7-48e8-866c-4c6f2c8db14b/reload/0.log" Sep 17 18:00:32.089126 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.089100 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69bd7cbbd6-p49lc_1369f48c-bbe7-48e8-866c-4c6f2c8db14b/kube-rbac-proxy/0.log" Sep 17 18:00:32.129893 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.129872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99fd6b7d-7dcpr_900a7b4d-e704-4f3d-ab7e-4d5d4027fd46/thanos-query/0.log" Sep 17 18:00:32.158975 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.158952 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99fd6b7d-7dcpr_900a7b4d-e704-4f3d-ab7e-4d5d4027fd46/kube-rbac-proxy-web/0.log" Sep 17 18:00:32.195094 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.195043 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99fd6b7d-7dcpr_900a7b4d-e704-4f3d-ab7e-4d5d4027fd46/kube-rbac-proxy/0.log" Sep 17 18:00:32.226657 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.226638 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99fd6b7d-7dcpr_900a7b4d-e704-4f3d-ab7e-4d5d4027fd46/prom-label-proxy/0.log" Sep 17 18:00:32.269810 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.269786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99fd6b7d-7dcpr_900a7b4d-e704-4f3d-ab7e-4d5d4027fd46/kube-rbac-proxy-rules/0.log" Sep 17 18:00:32.307206 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:32.307182 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99fd6b7d-7dcpr_900a7b4d-e704-4f3d-ab7e-4d5d4027fd46/kube-rbac-proxy-metrics/0.log" Sep 17 18:00:33.558509 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:33.558477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-52vn2_192384f4-56e7-4b2f-b553-522cdd885106/networking-console-plugin/0.log" Sep 17 18:00:34.065411 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.065378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/1.log" Sep 17 18:00:34.075662 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.075637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xt8qj_f204dbc5-eb0f-4da4-b548-7529e2ea4675/console-operator/2.log" Sep 17 18:00:34.539105 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.539074 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-2cs65_92999969-294d-4e0f-86a4-20e60c755917/download-server/0.log" Sep 17 18:00:34.566933 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.566908 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9"] Sep 17 18:00:34.567264 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.567251 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" Sep 17 18:00:34.567306 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.567265 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" Sep 17 18:00:34.567340 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.567330 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5c96dc-1b18-4654-a8bd-1290de36c199" containerName="model-chainer-raw-hpa-51535" Sep 17 18:00:34.570380 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.570363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.572384 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.572365 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx4r5\"/\"kube-root-ca.crt\"" Sep 17 18:00:34.572496 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.572365 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx4r5\"/\"openshift-service-ca.crt\"" Sep 17 18:00:34.572496 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.572447 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dx4r5\"/\"default-dockercfg-jd7vc\"" Sep 17 18:00:34.579139 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.579115 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9"] Sep 17 18:00:34.700124 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.700099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-lib-modules\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.700266 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.700129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-proc\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.700266 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.700159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-podres\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.700266 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.700242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-sys\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.700441 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.700272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6bw\" (UniqueName: \"kubernetes.io/projected/26b0ee4f-4314-42ff-a0f7-8cf349800691-kube-api-access-rp6bw\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.800845 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-sys\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.800845 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp6bw\" (UniqueName: \"kubernetes.io/projected/26b0ee4f-4314-42ff-a0f7-8cf349800691-kube-api-access-rp6bw\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801017 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-lib-modules\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801017 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-proc\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801017 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-podres\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801017 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800897 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-sys\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801017 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.800976 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-proc\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801217 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.801026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-lib-modules\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.801217 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.801085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26b0ee4f-4314-42ff-a0f7-8cf349800691-podres\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.809363 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.809335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp6bw\" (UniqueName: \"kubernetes.io/projected/26b0ee4f-4314-42ff-a0f7-8cf349800691-kube-api-access-rp6bw\") pod \"perf-node-gather-daemonset-zvgt9\" (UID: \"26b0ee4f-4314-42ff-a0f7-8cf349800691\") " pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:34.880585 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:34.880561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:35.113430 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:35.113342 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-nv87b_62568fdc-8cb9-488b-98e2-fc8ea0ce20fa/volume-data-source-validator/0.log" Sep 17 18:00:35.151270 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:35.151183 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9"] Sep 17 18:00:35.153836 ip-10-0-132-90 kubenswrapper[2580]: W0917 18:00:35.153812 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod26b0ee4f_4314_42ff_a0f7_8cf349800691.slice/crio-fc6ddc0852d0e451bfcbab785efa4134a0c47a0bc1c33edf6889dec44d48f5d2 WatchSource:0}: Error finding container fc6ddc0852d0e451bfcbab785efa4134a0c47a0bc1c33edf6889dec44d48f5d2: Status 404 returned error can't find the container with id fc6ddc0852d0e451bfcbab785efa4134a0c47a0bc1c33edf6889dec44d48f5d2 Sep 17 18:00:35.446880 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:35.446801 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" event={"ID":"26b0ee4f-4314-42ff-a0f7-8cf349800691","Type":"ContainerStarted","Data":"2f35c3ec4a6ba0e264644fc3c18fca92d213b116e45bec756dddb0951e8c762c"} Sep 17 18:00:35.446880 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:35.446857 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" event={"ID":"26b0ee4f-4314-42ff-a0f7-8cf349800691","Type":"ContainerStarted","Data":"fc6ddc0852d0e451bfcbab785efa4134a0c47a0bc1c33edf6889dec44d48f5d2"} Sep 17 18:00:35.447037 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:35.446886 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:35.462965 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:35.462922 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" podStartSLOduration=1.4629073639999999 podStartE2EDuration="1.462907364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:00:35.461286064 +0000 UTC m=+1594.637680184" watchObservedRunningTime="2026-09-17 18:00:35.462907364 +0000 UTC m=+1594.639301469" Sep 17 18:00:36.158482 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:36.158449 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h5gsc_860fa8b0-d877-4314-b97e-97eb26ee337b/dns/0.log" Sep 17 18:00:36.188656 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:36.188628 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h5gsc_860fa8b0-d877-4314-b97e-97eb26ee337b/kube-rbac-proxy/0.log" Sep 17 18:00:36.332925 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:36.332904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m6zw8_99c43776-aa7e-485b-9b2a-32e2acca7601/dns-node-resolver/0.log" Sep 17 18:00:36.872338 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:36.872312 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8sj6_af388933-e192-4d07-82db-3a014715264b/node-ca/0.log" Sep 17 18:00:38.051565 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:38.051533 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ms5dq_d5a9bd5d-4cbd-48ac-aa75-1d94b099a0f3/serve-healthcheck-canary/0.log" Sep 17 18:00:38.561259 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:38.561224 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bldj9_ab6443fa-e410-40c4-9b6e-b23609af2fc4/kube-rbac-proxy/0.log" Sep 17 18:00:38.593636 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:38.593612 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bldj9_ab6443fa-e410-40c4-9b6e-b23609af2fc4/exporter/0.log" Sep 17 18:00:38.624794 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:38.624768 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bldj9_ab6443fa-e410-40c4-9b6e-b23609af2fc4/extractor/0.log" Sep 17 18:00:41.191676 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:41.191645 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-sgwkg_6baed8cd-4962-4fac-b604-be4167c5b221/server/0.log" Sep 17 18:00:41.412157 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:41.412127 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-hdmmm_2ecb73a7-6d15-4b22-9ea1-14e2ae2d6f27/manager/0.log" Sep 17 18:00:41.460683 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:41.460626 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dx4r5/perf-node-gather-daemonset-zvgt9" Sep 17 18:00:41.499972 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:41.499943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-pwkdp_bd738959-96b0-474d-948c-6debe58b0449/seaweedfs/0.log" Sep 17 18:00:47.382130 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.382099 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/kube-multus-additional-cni-plugins/0.log" Sep 17 18:00:47.410018 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.409992 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/egress-router-binary-copy/0.log" Sep 17 18:00:47.438805 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.438788 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/cni-plugins/0.log" Sep 17 18:00:47.467644 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.467626 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/bond-cni-plugin/0.log" Sep 17 18:00:47.492946 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.492893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/routeoverride-cni/0.log" Sep 17 18:00:47.519636 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.519614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/whereabouts-cni-bincopy/0.log" Sep 17 18:00:47.542970 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.542949 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4kp9x_bc2ad0b5-f294-4f12-9f91-2089a7c4d8c5/whereabouts-cni/0.log" Sep 17 18:00:47.999972 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:47.999939 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b7bv8_960f710a-ef19-42de-bc76-782c41e594c0/kube-multus/0.log" Sep 17 18:00:48.118509 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:48.118489 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-76whh_2d8eadcd-005e-4f1f-91c0-076b0498988d/network-metrics-daemon/0.log" Sep 17 18:00:48.153117 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:48.153089 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-76whh_2d8eadcd-005e-4f1f-91c0-076b0498988d/kube-rbac-proxy/0.log" Sep 17 18:00:49.295498 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.295466 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-controller/0.log" Sep 17 18:00:49.320146 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.320114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/1.log" Sep 17 18:00:49.320287 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.320158 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovn-acl-logging/0.log" Sep 17 18:00:49.344762 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.344737 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/kube-rbac-proxy-node/0.log" Sep 17 18:00:49.370413 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.370369 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 18:00:49.406073 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.406050 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/northd/0.log" Sep 17 18:00:49.430831 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.430811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/nbdb/0.log" Sep 17 18:00:49.453912 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.453889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/sbdb/0.log" Sep 17 18:00:49.512485 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:49.512465 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncbx8_cdf25810-be21-472f-8600-5beda9359004/ovnkube-controller/0.log" Sep 17 18:00:50.883919 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:50.883890 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-48pl7_a131a629-0149-4409-b083-a4dd34ea74d4/network-check-target-container/0.log" Sep 17 18:00:51.978233 ip-10-0-132-90 kubenswrapper[2580]: I0917 18:00:51.978154 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-j59qq_5ff0f726-582d-4204-b757-35b4575cd629/iptables-alerter/0.log"