Sep 18 13:19:07.583459 ip-10-0-133-74 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 13:19:07.583474 ip-10-0-133-74 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 13:19:07.583484 ip-10-0-133-74 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 13:19:07.583714 ip-10-0-133-74 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 13:19:17.706579 ip-10-0-133-74 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 13:19:17.706595 ip-10-0-133-74 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 611a42772b8045aa9d6929edb7f649d7 -- Sep 18 13:21:09.427980 ip-10-0-133-74 systemd[1]: Starting Kubernetes Kubelet... Sep 18 13:21:13.126174 ip-10-0-133-74 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:21:13.126174 ip-10-0-133-74 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 13:21:13.126174 ip-10-0-133-74 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:21:13.126174 ip-10-0-133-74 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 13:21:13.126174 ip-10-0-133-74 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:21:13.126890 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.126620 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 13:21:13.131667 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131651 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:21:13.131667 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131667 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131688 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131692 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131695 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131698 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131701 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131704 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131706 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131709 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131711 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131714 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131719 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131722 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131725 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131728 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131735 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131738 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131741 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131744 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131746 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:21:13.131761 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131749 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131752 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131755 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131757 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131760 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131763 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131765 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131768 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131771 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131773 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131776 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131778 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131782 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131785 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131788 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131791 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131795 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131797 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131800 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:21:13.132226 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131803 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131805 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131808 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131810 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131814 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131816 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131819 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131822 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131824 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131827 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131830 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131833 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131835 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131838 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131841 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131844 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131847 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131850 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131852 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131854 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:21:13.132731 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131857 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131861 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131864 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131867 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131869 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131872 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131875 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131877 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131880 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131882 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131884 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131888 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131891 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131893 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131896 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131898 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131900 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131903 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131906 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:21:13.133210 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131910 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131912 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131915 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131917 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131920 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131922 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131924 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131927 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131930 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131932 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131935 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131937 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131940 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131942 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131945 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131947 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131950 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131952 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131955 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.131957 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:21:13.133662 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133276 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133284 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133288 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133291 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133295 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133300 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133303 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133306 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133309 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133312 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133315 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133317 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133320 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133323 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133326 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133330 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133333 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133336 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133338 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:21:13.134150 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133341 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133344 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133346 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133349 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133352 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133354 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133357 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133360 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133363 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133365 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133367 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133370 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133373 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133376 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133378 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133381 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133383 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133386 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133388 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133391 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:21:13.134617 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133394 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133396 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133399 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133401 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133404 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133406 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133408 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133412 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133415 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133417 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133420 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133423 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133425 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133428 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133431 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133433 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133436 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133438 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133441 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133443 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:21:13.135211 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133446 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133448 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133451 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133453 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133456 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133458 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133461 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133463 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133466 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133468 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133470 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133473 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133476 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133478 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133481 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133484 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133486 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133489 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133491 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133494 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:21:13.135722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133496 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133498 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133501 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133503 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133505 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133508 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133511 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133513 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133516 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133518 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133521 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133523 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133526 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133529 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133533 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133536 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133539 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133541 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133544 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:21:13.136196 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.133547 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134416 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134423 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134426 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134429 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134432 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134435 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134438 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134440 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134443 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134445 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134448 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134450 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134452 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134455 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134457 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134459 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134462 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134465 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:21:13.136651 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134467 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134470 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134472 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134474 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134477 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134479 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134482 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134484 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134486 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134489 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134492 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134494 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134496 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134499 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134501 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134504 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134506 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134508 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134511 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134517 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:21:13.137118 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134519 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134521 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134524 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134526 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134528 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134531 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134533 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134535 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134538 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134540 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134542 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134545 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134548 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134550 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134553 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134555 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134558 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134560 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134562 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134565 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:21:13.137594 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134567 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134570 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134572 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134575 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134577 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134580 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134583 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134585 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134588 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134592 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134596 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134600 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134605 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134607 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134610 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134613 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134615 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134617 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134620 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:21:13.138102 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134623 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134625 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134628 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134630 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134634 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134636 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134639 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134642 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134645 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134647 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134650 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134652 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134656 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134659 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134662 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134665 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134668 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134686 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134690 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134694 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:21:13.138547 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134696 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.134699 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134761 2563 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134793 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134801 2563 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134814 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134821 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134825 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134829 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134837 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134840 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134843 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134847 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134850 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134853 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134856 2563 flags.go:64] FLAG: --cgroup-root="" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134858 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134861 2563 flags.go:64] FLAG: --client-ca-file="" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134864 2563 flags.go:64] FLAG: --cloud-provider="external" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134867 2563 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134871 2563 flags.go:64] FLAG: --cluster-domain="" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134873 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134876 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134879 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 13:21:13.139113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134882 2563 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134886 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134889 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134892 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134895 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134897 2563 flags.go:64] FLAG: --contention-profiling="false" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134900 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134903 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134906 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134909 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134913 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134915 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134918 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134921 2563 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134923 2563 flags.go:64] FLAG: --enable-server="true" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134927 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134931 2563 flags.go:64] FLAG: --event-burst="100" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134934 2563 flags.go:64] FLAG: --event-qps="50" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134937 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134940 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134942 2563 flags.go:64] FLAG: --eviction-hard="" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134946 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134949 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134951 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134957 2563 flags.go:64] FLAG: --eviction-soft="" Sep 18 13:21:13.139670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134959 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134962 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134965 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134968 2563 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134971 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134974 2563 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134976 2563 flags.go:64] FLAG: --feature-gates="" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134980 2563 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134983 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134986 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134989 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134992 2563 flags.go:64] FLAG: --healthz-port="10248" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134995 2563 flags.go:64] FLAG: --help="false" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.134997 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135000 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135003 2563 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135006 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135009 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135012 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135015 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135018 2563 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135021 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135023 2563 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 13:21:13.140314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135027 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135030 2563 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135033 2563 flags.go:64] FLAG: --kube-reserved="" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135035 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135038 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135041 2563 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135044 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135046 2563 flags.go:64] FLAG: --lock-file="" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135050 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135053 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135057 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135063 2563 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135065 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135068 2563 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135071 2563 flags.go:64] FLAG: --logging-format="text" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135073 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135077 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135079 2563 flags.go:64] FLAG: --manifest-url="" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135082 2563 flags.go:64] FLAG: --manifest-url-header="" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135086 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135089 2563 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135093 2563 flags.go:64] FLAG: --max-pods="110" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135096 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135098 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135101 2563 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 13:21:13.140936 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135104 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135107 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135110 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135113 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135120 2563 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135123 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135126 2563 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135129 2563 flags.go:64] FLAG: --pod-cidr="" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135132 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135137 2563 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135140 2563 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135143 2563 flags.go:64] FLAG: --pods-per-core="0" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135146 2563 flags.go:64] FLAG: --port="10250" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135149 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135152 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d91c096750932aa" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135155 2563 flags.go:64] FLAG: --qos-reserved="" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135159 2563 flags.go:64] FLAG: --read-only-port="10255" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135163 2563 flags.go:64] FLAG: --register-node="true" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135166 2563 flags.go:64] FLAG: --register-with-taints="" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135170 2563 flags.go:64] FLAG: --registry-burst="10" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135173 2563 flags.go:64] FLAG: --registry-qps="5" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135175 2563 flags.go:64] FLAG: --reserved-cpus="" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135178 2563 flags.go:64] FLAG: --reserved-memory="" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135182 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135185 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 13:21:13.141547 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135187 2563 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135190 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135193 2563 flags.go:64] FLAG: --runonce="false" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135196 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135199 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135201 2563 flags.go:64] FLAG: --seccomp-default="false" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135204 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135207 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135210 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135213 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135216 2563 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135219 2563 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135222 2563 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135225 2563 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135228 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135231 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135234 2563 flags.go:64] FLAG: --system-cgroups="" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135237 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135242 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135245 2563 flags.go:64] FLAG: --tls-cert-file="" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135248 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135251 2563 flags.go:64] FLAG: --tls-min-version="" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135254 2563 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135257 2563 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135266 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 13:21:13.142227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135268 2563 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135271 2563 flags.go:64] FLAG: --v="2" Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135275 2563 flags.go:64] FLAG: --version="false" Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135279 2563 flags.go:64] FLAG: --vmodule="" Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135283 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.135286 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135396 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135399 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135403 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135408 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135412 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135417 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135420 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135423 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135426 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135428 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135431 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135433 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135436 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135440 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:21:13.142873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135444 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135447 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135449 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135452 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135456 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135459 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135462 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135464 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135467 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135469 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135473 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135477 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135480 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135482 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135485 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135487 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135490 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135493 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135495 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135498 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:21:13.143355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135500 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135503 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135505 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135508 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135510 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135513 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135516 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135518 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135521 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135523 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135527 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135530 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135532 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135535 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135537 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135540 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135542 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135545 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135548 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135550 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:21:13.143861 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135553 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135555 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135559 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135563 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135566 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135568 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135571 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135573 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135577 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135580 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135583 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135586 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135588 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135591 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135593 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135596 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135598 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135601 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135604 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:21:13.144355 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135606 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135609 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135611 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135614 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135616 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135619 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135621 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135624 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135626 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135628 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135631 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135634 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135636 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135639 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135641 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135645 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135648 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135651 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135653 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135656 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:21:13.144876 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135658 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135661 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135663 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135666 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135668 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.135688 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.136225 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.143240 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.143254 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.143274 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.143279 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143333 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143339 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143342 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143345 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:21:13.145343 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143349 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143351 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143354 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143357 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143360 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143363 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143366 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143369 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143373 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143376 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143380 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143383 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143385 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143388 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143392 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143394 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143398 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143401 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143404 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:21:13.145725 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143407 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143409 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143413 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143417 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143420 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143424 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143427 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143431 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143434 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143437 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143440 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143443 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143446 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143449 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143451 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143454 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143456 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143459 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143461 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:21:13.146187 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143464 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143467 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143470 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143474 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143478 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143481 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143484 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143486 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143490 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143492 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143495 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143498 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143500 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143503 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143506 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143508 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143511 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143514 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143516 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143519 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:21:13.146669 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143522 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143524 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143526 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143529 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143531 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143534 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143536 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143539 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143541 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143544 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143546 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143549 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143551 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143554 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143556 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143558 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143561 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143564 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143567 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143569 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:21:13.147276 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143572 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143574 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143577 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143579 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143581 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143584 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143586 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143589 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143591 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143594 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143596 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143599 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143601 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143604 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143606 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143608 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:21:13.147857 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143611 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.143616 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143743 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143749 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143752 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143755 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143758 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143761 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143763 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143766 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143768 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143771 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143773 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143776 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143779 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:21:13.148256 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143781 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143784 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143786 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143789 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143791 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143794 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143796 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143799 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143801 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143804 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143806 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143808 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143811 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143814 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143816 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143818 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143821 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143824 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143826 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143828 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:21:13.148803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143832 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143834 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143837 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143839 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143841 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143844 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143846 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143849 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143852 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143857 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143861 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143864 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143868 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143870 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143873 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143876 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143879 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143882 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143884 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:21:13.149633 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143887 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143889 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143891 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143894 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143896 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143899 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143902 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143904 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143907 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143910 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143912 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143915 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143917 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143920 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143922 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143924 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143927 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143929 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143932 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143934 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:21:13.150423 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143937 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143939 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143942 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143944 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143947 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143949 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143952 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143955 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143959 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143961 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143964 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143966 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143969 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143972 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143975 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143977 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143980 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143982 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143985 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:21:13.151227 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143988 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143990 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143993 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143995 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.143997 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.144000 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.144002 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:13.144005 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.144009 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.144103 2563 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.146071 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.146895 2563 server.go:1019] "Starting client certificate rotation" Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.147006 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:21:13.151730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.147055 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:21:13.152069 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.149074 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:21:13.153000 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.152980 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:21:13.157741 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.157722 2563 log.go:25] "Validated CRI v1 runtime API" Sep 18 13:21:13.159941 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.159631 2563 log.go:25] "Validated CRI v1 image API" Sep 18 13:21:13.161665 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.161649 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 13:21:13.165822 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.165804 2563 fs.go:135] Filesystem UUIDs: map[5252810e-ebcf-4624-ae90-f0f0fcadd475:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cc83fd42-ecfc-4a6a-b1d7-86da47587835:/dev/nvme0n1p4] Sep 18 13:21:13.165893 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.165822 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 13:21:13.170101 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.170001 2563 manager.go:216] Machine: {Timestamp:2026-09-18 13:21:13.169534661 +0000 UTC m=+2.076615314 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2888796 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21bdb9735a78ad8e748ecf1295742d SystemUUID:ec21bdb9-735a-78ad-8e74-8ecf1295742d BootID:611a4277-2b80-45aa-9d69-29edb7f649d7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e5:61:a7:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e5:61:a7:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:86:65:7d:9c:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 13:21:13.170101 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.170097 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 13:21:13.170202 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.170166 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 13:21:13.171589 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.171564 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 13:21:13.171734 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.171592 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 13:21:13.172744 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.172734 2563 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 13:21:13.172775 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.172747 2563 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 13:21:13.172775 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.172754 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:21:13.172775 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.172764 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:21:13.173908 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.173898 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 13:21:13.177520 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177509 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:21:13.177635 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177626 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 13:21:13.177669 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177658 2563 kubelet.go:486] "Attempting to sync node with API server" Sep 18 13:21:13.177669 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177669 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 13:21:13.177733 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177692 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 13:21:13.177733 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177701 2563 kubelet.go:398] "Adding apiserver pod source" Sep 18 13:21:13.177733 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.177709 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 13:21:13.178051 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.178036 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:21:13.178110 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.178063 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:21:13.180217 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.180199 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 13:21:13.182228 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.182210 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 13:21:13.182315 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.182249 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 13:21:13.183357 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183345 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183365 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183374 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183382 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183396 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183405 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183425 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 13:21:13.183436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183434 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 13:21:13.183706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183446 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 13:21:13.183706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183455 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 13:21:13.183706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183475 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 13:21:13.183706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183484 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 13:21:13.183706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183520 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 13:21:13.183706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.183538 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 13:21:13.187225 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.187210 2563 server.go:1268] "Started kubelet" Sep 18 13:21:13.187335 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.187306 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 13:21:13.187382 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.187296 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 13:21:13.187382 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.187363 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 13:21:13.220711 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.220667 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 13:21:13.221105 ip-10-0-133-74 systemd[1]: Started Kubernetes Kubelet. Sep 18 13:21:13.221744 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.221693 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 13:21:13.222372 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.222123 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:21:13.222455 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.222373 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 13:21:13.222589 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.222564 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 13:21:13.222882 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.222829 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 13:21:13.226523 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.226508 2563 server.go:310] "Adding debug handlers to kubelet server" Sep 18 13:21:13.229588 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.229564 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 13:21:13.229588 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.229572 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 13:21:13.229746 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.229711 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.230371 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230329 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 13:21:13.230580 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230567 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 13:21:13.230693 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230666 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 13:21:13.230761 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.229298 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18d66cee6b74d2c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-09-18 13:21:13.187185349 +0000 UTC m=+2.094266002,LastTimestamp:2026-09-18 13:21:13.187185349 +0000 UTC m=+2.094266002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}" Sep 18 13:21:13.230840 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230821 2563 reconstruct.go:97] "Volume reconstruction finished" Sep 18 13:21:13.230840 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230829 2563 reconciler.go:29] "Reconciler: start to sync state" Sep 18 13:21:13.230953 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230892 2563 factory.go:55] Registering systemd factory Sep 18 13:21:13.230953 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.230907 2563 factory.go:223] Registration of the systemd container factory successfully Sep 18 13:21:13.231278 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.231261 2563 factory.go:153] Registering CRI-O factory Sep 18 13:21:13.231352 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.231283 2563 factory.go:223] Registration of the crio container factory successfully Sep 18 13:21:13.231352 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.231338 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 13:21:13.231459 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.231357 2563 factory.go:103] Registering Raw factory Sep 18 13:21:13.231459 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.231372 2563 manager.go:1196] Started watching for new ooms in manager Sep 18 13:21:13.232113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.232085 2563 manager.go:349] Starting recovery of all containers Sep 18 13:21:13.240741 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.240719 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 13:21:13.240887 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.240864 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 13:21:13.244208 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.244072 2563 manager.go:354] Recovery completed Sep 18 13:21:13.247957 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.247941 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.249472 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.249456 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.249554 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.249484 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.249554 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.249493 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.250077 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250062 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 13:21:13.250077 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250073 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 13:21:13.250226 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250089 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:21:13.250226 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250121 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.250786 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250771 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.250848 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250798 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.250848 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.250834 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.252367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.252355 2563 policy_none.go:49] "None policy: Start" Sep 18 13:21:13.252414 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.252371 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 13:21:13.252414 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.252380 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 13:21:13.254299 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.254289 2563 policy_none.go:47] "Start" Sep 18 13:21:13.258256 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.258152 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18d66cee6f2b3ca4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-09-18 13:21:13.249471652 +0000 UTC m=+2.156552303,LastTimestamp:2026-09-18 13:21:13.249471652 +0000 UTC m=+2.156552303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}" Sep 18 13:21:13.263079 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.263062 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jmfnz" Sep 18 13:21:13.263322 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.263268 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18d66cee6f2b7db6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-09-18 13:21:13.24948831 +0000 UTC m=+2.156568962,LastTimestamp:2026-09-18 13:21:13.24948831 +0000 UTC m=+2.156568962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}" Sep 18 13:21:13.278477 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.278393 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18d66cee6f2b9ffe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-74.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-09-18 13:21:13.249497086 +0000 UTC m=+2.156577737,LastTimestamp:2026-09-18 13:21:13.249497086 +0000 UTC m=+2.156577737,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}" Sep 18 13:21:13.281743 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.281725 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jmfnz" Sep 18 13:21:13.288481 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.288399 2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-74.ec2.internal.18d66cee6f2b3ca4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18d66cee6f2b3ca4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-09-18 13:21:13.249471652 +0000 UTC m=+2.156552303,LastTimestamp:2026-09-18 13:21:13.25078593 +0000 UTC m=+2.157866581,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}" Sep 18 13:21:13.289367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289349 2563 manager.go:337] "Starting Device Plugin manager" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.289382 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289391 2563 server.go:87] "Starting device plugin registration server" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289611 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289629 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289758 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289832 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.289840 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.290305 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 13:21:13.308921 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.290362 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.370375 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.370347 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 13:21:13.371636 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.371622 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 13:21:13.371745 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.371688 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 13:21:13.371745 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.371712 2563 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 13:21:13.371841 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.371778 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 13:21:13.375417 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.375399 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:21:13.390309 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.390299 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.391104 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.391088 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.391193 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.391122 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.391193 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.391137 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.391193 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.391158 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.412057 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.412040 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.412126 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.412061 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-74.ec2.internal\": node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.451356 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.451332 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.472421 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.472400 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"] Sep 18 13:21:13.472498 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.472464 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.473290 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.473264 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.473381 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.473295 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.473381 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.473306 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.475475 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.475463 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.475640 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.475626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.475696 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.475656 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.476206 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.476193 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.476281 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.476197 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.476281 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.476245 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.476281 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.476260 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.476281 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.476221 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.476455 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.476286 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.478392 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.478375 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.478454 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.478411 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:13.479135 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.479118 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:13.479214 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.479146 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:13.479214 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.479156 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:13.501331 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.501308 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-74.ec2.internal\" not found" node="ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.505847 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.505832 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-74.ec2.internal\" not found" node="ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.532098 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.532073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80f28ff51d6bc38f682b08998ef4d271-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"80f28ff51d6bc38f682b08998ef4d271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.532184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.532110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f28ff51d6bc38f682b08998ef4d271-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"80f28ff51d6bc38f682b08998ef4d271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.532184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.532132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/471380efb1dd06918a8b1c45701cf938-config\") pod \"kube-apiserver-proxy-ip-10-0-133-74.ec2.internal\" (UID: \"471380efb1dd06918a8b1c45701cf938\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.552153 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.552135 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.632404 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.632382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/471380efb1dd06918a8b1c45701cf938-config\") pod \"kube-apiserver-proxy-ip-10-0-133-74.ec2.internal\" (UID: \"471380efb1dd06918a8b1c45701cf938\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.632499 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.632406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80f28ff51d6bc38f682b08998ef4d271-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"80f28ff51d6bc38f682b08998ef4d271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.632499 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.632425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f28ff51d6bc38f682b08998ef4d271-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"80f28ff51d6bc38f682b08998ef4d271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.632499 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.632467 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f28ff51d6bc38f682b08998ef4d271-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"80f28ff51d6bc38f682b08998ef4d271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.632499 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.632483 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/471380efb1dd06918a8b1c45701cf938-config\") pod \"kube-apiserver-proxy-ip-10-0-133-74.ec2.internal\" (UID: \"471380efb1dd06918a8b1c45701cf938\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.632499 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.632493 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80f28ff51d6bc38f682b08998ef4d271-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"80f28ff51d6bc38f682b08998ef4d271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.652981 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.652932 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.753520 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.753496 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.804619 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.804594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.809798 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:13.809583 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" Sep 18 13:21:13.853797 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.853769 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:13.954403 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:13.954332 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:14.052367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.052339 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:21:14.055364 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:14.055341 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:14.147065 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.147044 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 13:21:14.147457 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.147161 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 13:21:14.147457 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.147186 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 13:21:14.156298 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:14.156271 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:14.256589 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:14.256523 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found" Sep 18 13:21:14.286492 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.286460 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 13:16:13 +0000 UTC" deadline="2028-05-26 01:46:03.118300046 +0000 UTC" Sep 18 13:21:14.286492 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.286488 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14772h24m48.831814647s" Sep 18 13:21:14.334947 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.334925 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:21:14.336290 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.336273 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:21:14.336392 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.336305 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:21:14.336392 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.336315 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:21:14.343598 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.343580 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:21:14.430256 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.430230 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" Sep 18 13:21:14.445417 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.445401 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:21:14.446347 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.446334 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" Sep 18 13:21:14.446897 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.446881 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:21:14.458592 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.458572 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:21:14.475130 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:14.475108 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f28ff51d6bc38f682b08998ef4d271.slice/crio-3ef5034ae854a485828fb8fba8296244c6a60afb1e71192c01edd49e7ea49e68 WatchSource:0}: Error finding container 3ef5034ae854a485828fb8fba8296244c6a60afb1e71192c01edd49e7ea49e68: Status 404 returned error can't find the container with id 3ef5034ae854a485828fb8fba8296244c6a60afb1e71192c01edd49e7ea49e68 Sep 18 13:21:14.475722 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:14.475704 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471380efb1dd06918a8b1c45701cf938.slice/crio-1d3f5e167e562ab4f97e0cc423bec87e0a698faf64775f77012730b1b4c16f97 WatchSource:0}: Error finding container 1d3f5e167e562ab4f97e0cc423bec87e0a698faf64775f77012730b1b4c16f97: Status 404 returned error can't find the container with id 1d3f5e167e562ab4f97e0cc423bec87e0a698faf64775f77012730b1b4c16f97 Sep 18 13:21:14.480855 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:14.480819 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:21:15.178514 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.178485 2563 apiserver.go:52] "Watching apiserver" Sep 18 13:21:15.186515 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.186354 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 13:21:15.186860 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.186833 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-s5chn","openshift-ovn-kubernetes/ovnkube-node-rfhfl","kube-system/konnectivity-agent-s8ppl","kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal","openshift-dns/node-resolver-jwgfh","openshift-image-registry/node-ca-lnqlz","openshift-multus/multus-additional-cni-plugins-64xdc","openshift-multus/multus-ts5zr","openshift-network-diagnostics/network-check-target-4swtf","kube-system/global-pull-secret-syncer-rnvc5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv","openshift-cluster-node-tuning-operator/tuned-bbgnk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal","openshift-multus/network-metrics-daemon-hptsl"] Sep 18 13:21:15.189795 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.189442 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.189795 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.189508 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:15.192560 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.191581 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.195900 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qqf78\"" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.196096 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.196280 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.196490 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.196774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.196803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.197158 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.196855 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:15.198472 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.198010 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.203069 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.202963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:15.203069 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.203012 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.203069 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.203022 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:15.205653 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205214 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.205653 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205329 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 13:21:15.205653 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205368 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-59mtc\"" Sep 18 13:21:15.205653 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205600 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.205870 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 13:21:15.205870 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mm9bw\"" Sep 18 13:21:15.205939 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.205880 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.207539 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.207521 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.209105 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209085 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 13:21:15.209197 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wn5wz\"" Sep 18 13:21:15.209284 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209269 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.209284 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 13:21:15.209980 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209407 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 13:21:15.209980 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.209980 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209531 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.209980 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209657 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.209980 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209876 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xkblt\"" Sep 18 13:21:15.209980 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.209965 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 13:21:15.210287 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.210089 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.210836 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.210815 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.212978 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.212245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.215386 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.215255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.215478 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.215435 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.215533 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.215505 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 13:21:15.215609 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.215595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 13:21:15.222007 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.221988 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv6qn\"" Sep 18 13:21:15.222353 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.222337 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 13:21:15.222555 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.222541 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 13:21:15.222706 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.222690 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4ct7\"" Sep 18 13:21:15.222893 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.222864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7jxgv\"" Sep 18 13:21:15.222893 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.222882 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.223010 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.222940 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 13:21:15.223512 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.223489 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 13:21:15.223700 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.223544 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.226129 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.226104 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:21:15.226228 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.226146 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 13:21:15.226228 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.226188 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b6tdc\"" Sep 18 13:21:15.230742 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.230115 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 13:21:15.231747 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.231729 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm4cl\" (UniqueName: \"kubernetes.io/projected/f762345d-70e3-46d9-a52d-477f85f73b46-kube-api-access-jm4cl\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts96j\" (UniqueName: \"kubernetes.io/projected/bd3adf38-4873-4761-a02b-16102f508c23-kube-api-access-ts96j\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-run\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-sys\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbx87\" (UniqueName: \"kubernetes.io/projected/5b5996a5-2a7d-4702-8837-0c1d63b28b29-kube-api-access-lbx87\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.238285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-env-overrides\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysctl-d\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-lib-modules\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-tuned\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq7g2\" (UniqueName: \"kubernetes.io/projected/d4ab57bd-e909-439c-8bef-dee757001f1c-kube-api-access-mq7g2\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-socket-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-sys-fs\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-etc-kubernetes\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-kubelet\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-ovn\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238600 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmz4\" (UniqueName: \"kubernetes.io/projected/fb5f590f-bc75-41e9-8192-61f250e5d139-kube-api-access-xbmz4\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-socket-dir-parent\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-systemd\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.238762 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-cnibin\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-systemd\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5996a5-2a7d-4702-8837-0c1d63b28b29-tmp-dir\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-system-cni-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-cni-bin\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-var-lib-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-modprobe-d\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-k8s-cni-cncf-io\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-daemon-config\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-systemd-units\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-run-ovn-kubernetes\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-cni-multus\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.238988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-etc-selinux\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-kubernetes\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.239334 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-device-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6mv6\" (UniqueName: \"kubernetes.io/projected/dab052e0-0cda-4e03-a4c3-dd04034edd02-kube-api-access-s6mv6\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-kubelet\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-conf-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-etc-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-node-log\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-ovnkube-config\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-cni-binary-copy\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysctl-conf\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvnkq\" (UniqueName: \"kubernetes.io/projected/c44dc0a0-9161-48e0-afae-adbb470c819d-kube-api-access-rvnkq\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-slash\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-log-socket\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb5f590f-bc75-41e9-8192-61f250e5d139-iptables-alerter-script\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38650e3-2986-4c1f-a83b-9559ae7fbcff-dbus\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f762345d-70e3-46d9-a52d-477f85f73b46-host\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.240072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38650e3-2986-4c1f-a83b-9559ae7fbcff-kubelet-config\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sn84\" (UniqueName: \"kubernetes.io/projected/d91a8ab9-e813-4d4f-b76c-87c102b623bc-kube-api-access-7sn84\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c44dc0a0-9161-48e0-afae-adbb470c819d-cni-binary-copy\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-netns\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-run-netns\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-ovnkube-script-lib\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb5f590f-bc75-41e9-8192-61f250e5d139-host-slash\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkd9w\" (UniqueName: \"kubernetes.io/projected/8432a36c-65d6-4aa0-a995-12f6bdb53113-kube-api-access-xkd9w\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-var-lib-kubelet\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-multus-certs\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f762345d-70e3-46d9-a52d-477f85f73b46-serviceca\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-system-cni-dir\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-host\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a6e5ed1-5978-4c60-b6eb-2b86749d34fc-konnectivity-ca\") pod \"konnectivity-agent-s8ppl\" (UID: \"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc\") " pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-registration-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-cni-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.240818 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-cni-bin\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysconfig\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4ab57bd-e909-439c-8bef-dee757001f1c-tmp\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd3adf38-4873-4761-a02b-16102f508c23-ovn-node-metrics-cert\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a6e5ed1-5978-4c60-b6eb-2b86749d34fc-agent-certs\") pod \"konnectivity-agent-s8ppl\" (UID: \"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc\") " pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.239955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-hostroot\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.240084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.240110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b5996a5-2a7d-4702-8837-0c1d63b28b29-hosts-file\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.240147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-cnibin\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.241631 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.240170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-cni-netd\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.246745 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.246726 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:21:15.278304 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.278273 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-krt2x" Sep 18 13:21:15.287181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.287162 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-krt2x" Sep 18 13:21:15.341344 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-cni-bin\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysconfig\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4ab57bd-e909-439c-8bef-dee757001f1c-tmp\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341436 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-cni-bin\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysconfig\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd3adf38-4873-4761-a02b-16102f508c23-ovn-node-metrics-cert\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.341504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.341873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a6e5ed1-5978-4c60-b6eb-2b86749d34fc-agent-certs\") pod \"konnectivity-agent-s8ppl\" (UID: \"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc\") " pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.341873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-hostroot\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.341873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341624 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-hostroot\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.342015 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341859 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 13:21:15.342015 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.341975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.342015 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b5996a5-2a7d-4702-8837-0c1d63b28b29-hosts-file\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-cnibin\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-cni-netd\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm4cl\" (UniqueName: \"kubernetes.io/projected/f762345d-70e3-46d9-a52d-477f85f73b46-kube-api-access-jm4cl\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts96j\" (UniqueName: \"kubernetes.io/projected/bd3adf38-4873-4761-a02b-16102f508c23-kube-api-access-ts96j\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-run\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-sys\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbx87\" (UniqueName: \"kubernetes.io/projected/5b5996a5-2a7d-4702-8837-0c1d63b28b29-kube-api-access-lbx87\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.342169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-env-overrides\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysctl-d\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-lib-modules\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-tuned\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq7g2\" (UniqueName: \"kubernetes.io/projected/d4ab57bd-e909-439c-8bef-dee757001f1c-kube-api-access-mq7g2\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-socket-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-sys-fs\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-etc-kubernetes\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-kubelet\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-ovn\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.342501 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmz4\" (UniqueName: \"kubernetes.io/projected/fb5f590f-bc75-41e9-8192-61f250e5d139-kube-api-access-xbmz4\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-socket-dir-parent\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-systemd\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-cnibin\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-systemd\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5996a5-2a7d-4702-8837-0c1d63b28b29-tmp-dir\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-system-cni-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342812 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-ovn\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342852 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-sys-fs\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-etc-kubernetes\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-cnibin\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342920 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b5996a5-2a7d-4702-8837-0c1d63b28b29-hosts-file\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342923 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-kubelet\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342967 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-run\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.343053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.342858 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-lib-modules\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.343767 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.343093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-cni-bin\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.343767 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.343263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-sys\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.343767 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.343400 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-cni-netd\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.343767 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.343600 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysctl-d\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.343928 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.343770 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344016 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5996a5-2a7d-4702-8837-0c1d63b28b29-tmp-dir\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344089 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-systemd\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.344192 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.344263 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:21:15.844243126 +0000 UTC m=+4.751323783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-var-lib-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-modprobe-d\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344470 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-system-cni-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:15.344807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344759 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-cni-bin\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344829 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-cnibin\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344895 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-var-lib-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-k8s-cni-cncf-io\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.344959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-socket-dir-parent\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345007 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-run-systemd\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-daemon-config\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345009 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-modprobe-d\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345046 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-k8s-cni-cncf-io\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-socket-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-systemd-units\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-run-ovn-kubernetes\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-cni-multus\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-run-ovn-kubernetes\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-etc-selinux\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-kubernetes\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-systemd-units\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.345452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-device-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6mv6\" (UniqueName: \"kubernetes.io/projected/dab052e0-0cda-4e03-a4c3-dd04034edd02-kube-api-access-s6mv6\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-kubelet\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-conf-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345474 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-env-overrides\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345524 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-kubelet\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-etc-selinux\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345553 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-daemon-config\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345563 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-conf-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-etc-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345601 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-kubernetes\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345601 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-var-lib-cni-multus\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-device-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-node-log\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-ovnkube-config\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-cni-binary-copy\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysctl-conf\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.346242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.345930 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a6e5ed1-5978-4c60-b6eb-2b86749d34fc-agent-certs\") pod \"konnectivity-agent-s8ppl\" (UID: \"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc\") " pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.346025 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvnkq\" (UniqueName: \"kubernetes.io/projected/c44dc0a0-9161-48e0-afae-adbb470c819d-kube-api-access-rvnkq\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.346109 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:21:15.846090836 +0000 UTC m=+4.753171493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-slash\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-log-socket\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb5f590f-bc75-41e9-8192-61f250e5d139-iptables-alerter-script\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38650e3-2986-4c1f-a83b-9559ae7fbcff-dbus\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f762345d-70e3-46d9-a52d-477f85f73b46-host\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346250 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-ovnkube-config\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346290 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-etc-openvswitch\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346287 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8432a36c-65d6-4aa0-a995-12f6bdb53113-cni-binary-copy\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346314 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-slash\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38650e3-2986-4c1f-a83b-9559ae7fbcff-kubelet-config\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-log-socket\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sn84\" (UniqueName: \"kubernetes.io/projected/d91a8ab9-e813-4d4f-b76c-87c102b623bc-kube-api-access-7sn84\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.346988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c44dc0a0-9161-48e0-afae-adbb470c819d-cni-binary-copy\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-node-log\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346387 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38650e3-2986-4c1f-a83b-9559ae7fbcff-dbus\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38650e3-2986-4c1f-a83b-9559ae7fbcff-kubelet-config\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-netns\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346427 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f762345d-70e3-46d9-a52d-477f85f73b46-host\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-run-netns\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346474 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-netns\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-ovnkube-script-lib\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb5f590f-bc75-41e9-8192-61f250e5d139-host-slash\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkd9w\" (UniqueName: \"kubernetes.io/projected/8432a36c-65d6-4aa0-a995-12f6bdb53113-kube-api-access-xkd9w\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-var-lib-kubelet\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346579 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-sysctl-conf\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-multus-certs\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f762345d-70e3-46d9-a52d-477f85f73b46-serviceca\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-system-cni-dir\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-host\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.347606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a6e5ed1-5978-4c60-b6eb-2b86749d34fc-konnectivity-ca\") pod \"konnectivity-agent-s8ppl\" (UID: \"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc\") " pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-registration-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-cni-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346873 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-host-run-multus-certs\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346926 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8432a36c-65d6-4aa0-a995-12f6bdb53113-system-cni-dir\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.346966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-host\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ab57bd-e909-439c-8bef-dee757001f1c-var-lib-kubelet\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347184 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3adf38-4873-4761-a02b-16102f508c23-host-run-netns\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347383 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c44dc0a0-9161-48e0-afae-adbb470c819d-cni-binary-copy\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a6e5ed1-5978-4c60-b6eb-2b86749d34fc-konnectivity-ca\") pod \"konnectivity-agent-s8ppl\" (UID: \"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc\") " pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c44dc0a0-9161-48e0-afae-adbb470c819d-multus-cni-dir\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347467 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb5f590f-bc75-41e9-8192-61f250e5d139-iptables-alerter-script\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347515 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dab052e0-0cda-4e03-a4c3-dd04034edd02-registration-dir\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347516 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb5f590f-bc75-41e9-8192-61f250e5d139-host-slash\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347651 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd3adf38-4873-4761-a02b-16102f508c23-ovnkube-script-lib\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.347783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f762345d-70e3-46d9-a52d-477f85f73b46-serviceca\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.348341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.348003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4ab57bd-e909-439c-8bef-dee757001f1c-tmp\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.350533 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.350510 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4ab57bd-e909-439c-8bef-dee757001f1c-etc-tuned\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.354057 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.353230 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:15.354057 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.353253 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:15.354057 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.353266 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:15.354057 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.353323 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:21:15.853307673 +0000 UTC m=+4.760388327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:15.355966 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.355943 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm4cl\" (UniqueName: \"kubernetes.io/projected/f762345d-70e3-46d9-a52d-477f85f73b46-kube-api-access-jm4cl\") pod \"node-ca-lnqlz\" (UID: \"f762345d-70e3-46d9-a52d-477f85f73b46\") " pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.356588 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.356567 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd3adf38-4873-4761-a02b-16102f508c23-ovn-node-metrics-cert\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.357381 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.357357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmz4\" (UniqueName: \"kubernetes.io/projected/fb5f590f-bc75-41e9-8192-61f250e5d139-kube-api-access-xbmz4\") pod \"iptables-alerter-s5chn\" (UID: \"fb5f590f-bc75-41e9-8192-61f250e5d139\") " pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.357490 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.357477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts96j\" (UniqueName: \"kubernetes.io/projected/bd3adf38-4873-4761-a02b-16102f508c23-kube-api-access-ts96j\") pod \"ovnkube-node-rfhfl\" (UID: \"bd3adf38-4873-4761-a02b-16102f508c23\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.358757 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.357860 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sn84\" (UniqueName: \"kubernetes.io/projected/d91a8ab9-e813-4d4f-b76c-87c102b623bc-kube-api-access-7sn84\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.358757 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.358216 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkd9w\" (UniqueName: \"kubernetes.io/projected/8432a36c-65d6-4aa0-a995-12f6bdb53113-kube-api-access-xkd9w\") pod \"multus-additional-cni-plugins-64xdc\" (UID: \"8432a36c-65d6-4aa0-a995-12f6bdb53113\") " pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.359008 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.358986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq7g2\" (UniqueName: \"kubernetes.io/projected/d4ab57bd-e909-439c-8bef-dee757001f1c-kube-api-access-mq7g2\") pod \"tuned-bbgnk\" (UID: \"d4ab57bd-e909-439c-8bef-dee757001f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.359344 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.359326 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6mv6\" (UniqueName: \"kubernetes.io/projected/dab052e0-0cda-4e03-a4c3-dd04034edd02-kube-api-access-s6mv6\") pod \"aws-ebs-csi-driver-node-f64tv\" (UID: \"dab052e0-0cda-4e03-a4c3-dd04034edd02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.359956 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.359919 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbx87\" (UniqueName: \"kubernetes.io/projected/5b5996a5-2a7d-4702-8837-0c1d63b28b29-kube-api-access-lbx87\") pod \"node-resolver-jwgfh\" (UID: \"5b5996a5-2a7d-4702-8837-0c1d63b28b29\") " pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.360585 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.360563 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvnkq\" (UniqueName: \"kubernetes.io/projected/c44dc0a0-9161-48e0-afae-adbb470c819d-kube-api-access-rvnkq\") pod \"multus-ts5zr\" (UID: \"c44dc0a0-9161-48e0-afae-adbb470c819d\") " pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.379963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.379832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" event={"ID":"80f28ff51d6bc38f682b08998ef4d271","Type":"ContainerStarted","Data":"3ef5034ae854a485828fb8fba8296244c6a60afb1e71192c01edd49e7ea49e68"} Sep 18 13:21:15.381072 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.381050 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" event={"ID":"471380efb1dd06918a8b1c45701cf938","Type":"ContainerStarted","Data":"1d3f5e167e562ab4f97e0cc423bec87e0a698faf64775f77012730b1b4c16f97"} Sep 18 13:21:15.509772 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.509695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" Sep 18 13:21:15.523865 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.523844 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:15.533628 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.533599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jwgfh" Sep 18 13:21:15.540281 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.540265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnqlz" Sep 18 13:21:15.547859 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.547841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ts5zr" Sep 18 13:21:15.556653 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.556634 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:15.565330 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.565305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5chn" Sep 18 13:21:15.571986 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.571969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64xdc" Sep 18 13:21:15.583392 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.583372 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" Sep 18 13:21:15.633909 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.633879 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:21:15.849737 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.849653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:15.849737 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.849728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:15.849927 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.849818 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:15.849927 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.849857 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:15.849927 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.849898 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:21:16.849876532 +0000 UTC m=+5.756957171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:15.849927 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.849919 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:21:16.849908679 +0000 UTC m=+5.756989321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:15.950079 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:15.950037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:15.950234 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.950173 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:15.950234 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.950188 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:15.950234 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.950196 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:15.950353 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:15.950249 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:21:16.950232062 +0000 UTC m=+5.857312703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:16.290900 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.290864 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:16:15 +0000 UTC" deadline="2028-03-21 10:03:53.778793555 +0000 UTC" Sep 18 13:21:16.290900 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.290897 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13196h42m37.487901337s" Sep 18 13:21:16.372600 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.372565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:16.372753 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.372699 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:16.384415 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.384388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"f595dfd9740ec0f3e04cbe094dd1ebefa5e01fe58ff307825eed81987403022a"} Sep 18 13:21:16.385625 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:16.385603 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6e5ed1_5978_4c60_b6eb_2b86749d34fc.slice/crio-947f16ed6725e4e39dda539439b4c31329c41ab4e391790c715012d1fea35a9b WatchSource:0}: Error finding container 947f16ed6725e4e39dda539439b4c31329c41ab4e391790c715012d1fea35a9b: Status 404 returned error can't find the container with id 947f16ed6725e4e39dda539439b4c31329c41ab4e391790c715012d1fea35a9b Sep 18 13:21:16.386986 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:16.386960 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ab57bd_e909_439c_8bef_dee757001f1c.slice/crio-716ee943cd77aae0eb2ae3d72f222fa82fe86eca7c33b1b0cdbb1dbd2da04bb1 WatchSource:0}: Error finding container 716ee943cd77aae0eb2ae3d72f222fa82fe86eca7c33b1b0cdbb1dbd2da04bb1: Status 404 returned error can't find the container with id 716ee943cd77aae0eb2ae3d72f222fa82fe86eca7c33b1b0cdbb1dbd2da04bb1 Sep 18 13:21:16.391433 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:16.388701 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf762345d_70e3_46d9_a52d_477f85f73b46.slice/crio-24c070fd42e2b7fc9507e9003d5227a23d895a249bf4f950b91c2aabfaf2b076 WatchSource:0}: Error finding container 24c070fd42e2b7fc9507e9003d5227a23d895a249bf4f950b91c2aabfaf2b076: Status 404 returned error can't find the container with id 24c070fd42e2b7fc9507e9003d5227a23d895a249bf4f950b91c2aabfaf2b076 Sep 18 13:21:16.413139 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:16.413113 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab052e0_0cda_4e03_a4c3_dd04034edd02.slice/crio-6834218e0ccdf54d3c613855b00b6a34646f249592ed0f10fb662326abad375c WatchSource:0}: Error finding container 6834218e0ccdf54d3c613855b00b6a34646f249592ed0f10fb662326abad375c: Status 404 returned error can't find the container with id 6834218e0ccdf54d3c613855b00b6a34646f249592ed0f10fb662326abad375c Sep 18 13:21:16.415024 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:16.415000 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8432a36c_65d6_4aa0_a995_12f6bdb53113.slice/crio-3a4b9343b67fdd4fcd7c672b26aa80e85f120ab877ad0c19cf27048698064027 WatchSource:0}: Error finding container 3a4b9343b67fdd4fcd7c672b26aa80e85f120ab877ad0c19cf27048698064027: Status 404 returned error can't find the container with id 3a4b9343b67fdd4fcd7c672b26aa80e85f120ab877ad0c19cf27048698064027 Sep 18 13:21:16.857020 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.856724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:16.857179 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.857054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:16.857247 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.857184 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:16.857298 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.857246 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:21:18.857227293 +0000 UTC m=+7.764307956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:16.857722 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.857701 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:16.857813 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.857760 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:21:18.857743166 +0000 UTC m=+7.764823822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:16.875754 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.875729 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:21:16.958490 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:16.958452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:16.958690 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.958659 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:16.958757 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.958702 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:16.958757 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.958716 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:16.958875 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:16.958775 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:21:18.958756511 +0000 UTC m=+7.865837153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:17.291773 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.291704 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:16:15 +0000 UTC" deadline="2028-02-28 03:37:44.004823969 +0000 UTC" Sep 18 13:21:17.291773 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.291765 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12662h16m26.713063702s" Sep 18 13:21:17.375569 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.374913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:17.375569 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:17.375053 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:17.375569 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.375431 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:17.375569 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:17.375518 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:17.396979 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.396900 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jwgfh" event={"ID":"5b5996a5-2a7d-4702-8837-0c1d63b28b29","Type":"ContainerStarted","Data":"da48e157de9427421106d4fd248c81fcb09453956856f6b15e8dddc32dfc5314"} Sep 18 13:21:17.408488 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.408427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnqlz" event={"ID":"f762345d-70e3-46d9-a52d-477f85f73b46","Type":"ContainerStarted","Data":"24c070fd42e2b7fc9507e9003d5227a23d895a249bf4f950b91c2aabfaf2b076"} Sep 18 13:21:17.416351 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.416305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" event={"ID":"d4ab57bd-e909-439c-8bef-dee757001f1c","Type":"ContainerStarted","Data":"716ee943cd77aae0eb2ae3d72f222fa82fe86eca7c33b1b0cdbb1dbd2da04bb1"} Sep 18 13:21:17.430217 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.429401 2563 generic.go:356] "Generic (PLEG): container finished" podID="80f28ff51d6bc38f682b08998ef4d271" containerID="f6aa5beab673348e81678cb067ac6377702cf9d5d60189d904bc283e7661613f" exitCode=0 Sep 18 13:21:17.430217 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.430004 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" event={"ID":"80f28ff51d6bc38f682b08998ef4d271","Type":"ContainerDied","Data":"f6aa5beab673348e81678cb067ac6377702cf9d5d60189d904bc283e7661613f"} Sep 18 13:21:17.434339 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.433886 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" event={"ID":"471380efb1dd06918a8b1c45701cf938","Type":"ContainerStarted","Data":"06e9a746e52e0c6cfdbde3d1152bd8ebb7b432d69c969da948fdd6af66cca68b"} Sep 18 13:21:17.444899 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.444874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ts5zr" event={"ID":"c44dc0a0-9161-48e0-afae-adbb470c819d","Type":"ContainerStarted","Data":"15eb79b66b9009cbc2e9819653f3aee0797df0e8a268d99df6d47d71122a8023"} Sep 18 13:21:17.462541 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.462509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5chn" event={"ID":"fb5f590f-bc75-41e9-8192-61f250e5d139","Type":"ContainerStarted","Data":"4cb58454b2c03ea030568b00e99ec0681db78ecb5f7e9316b487f63b11fe8f1a"} Sep 18 13:21:17.473182 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.473154 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerStarted","Data":"3a4b9343b67fdd4fcd7c672b26aa80e85f120ab877ad0c19cf27048698064027"} Sep 18 13:21:17.496348 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.496318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" event={"ID":"dab052e0-0cda-4e03-a4c3-dd04034edd02","Type":"ContainerStarted","Data":"6834218e0ccdf54d3c613855b00b6a34646f249592ed0f10fb662326abad375c"} Sep 18 13:21:17.515445 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:17.515418 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s8ppl" event={"ID":"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc","Type":"ContainerStarted","Data":"947f16ed6725e4e39dda539439b4c31329c41ab4e391790c715012d1fea35a9b"} Sep 18 13:21:18.372999 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:18.372966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:18.373475 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.373095 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:18.546133 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:18.545831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" event={"ID":"80f28ff51d6bc38f682b08998ef4d271","Type":"ContainerStarted","Data":"4ab1187cc8b1e8135f443bd79124202e008c0cc9fa79b8ed281028b996ce7b08"} Sep 18 13:21:18.585766 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:18.585359 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" podStartSLOduration=4.585337932 podStartE2EDuration="4.585337932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:17.466647912 +0000 UTC m=+6.373728575" watchObservedRunningTime="2026-09-18 13:21:18.585337932 +0000 UTC m=+7.492418594" Sep 18 13:21:18.876722 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:18.875973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:18.876722 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:18.876068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:18.876722 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.876188 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:18.876722 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.876246 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:21:22.876228763 +0000 UTC m=+11.783309408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:18.876722 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.876616 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:18.876722 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.876664 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:21:22.876650518 +0000 UTC m=+11.783731177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:18.976791 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:18.976743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:18.976985 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.976967 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:18.977059 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.976996 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:18.977059 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.977008 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:18.977156 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:18.977073 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:21:22.977054968 +0000 UTC m=+11.884135610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:19.372188 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:19.372148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:19.372439 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:19.372295 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:19.372701 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:19.372664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:19.372804 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:19.372781 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:20.372610 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:20.372584 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:20.373071 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:20.372713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:21.372867 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:21.372341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:21.372867 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:21.372390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:21.372867 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:21.372501 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:21.372867 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:21.372845 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:22.372961 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:22.372926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:22.373360 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:22.373066 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:22.905725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:22.905691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:22.905921 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:22.905769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:22.905921 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:22.905882 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:22.906029 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:22.905942 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:21:30.905925634 +0000 UTC m=+19.813006273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:22.906392 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:22.906304 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:22.906392 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:22.906358 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:21:30.906342672 +0000 UTC m=+19.813423316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:23.007025 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:23.006986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:23.007186 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:23.007139 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:23.007186 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:23.007158 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:23.007186 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:23.007169 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:23.007348 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:23.007230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:21:31.007211898 +0000 UTC m=+19.914292551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:23.373601 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:23.373516 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:23.374050 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:23.373622 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:23.374050 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:23.373668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:23.374050 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:23.373764 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:24.372516 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:24.372059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:24.372516 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:24.372204 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:25.373840 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:25.373803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:25.374309 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:25.373944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:25.374309 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:25.374280 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:25.374414 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:25.374366 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:26.372123 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:26.372076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:26.372308 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:26.372206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:27.372248 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:27.372214 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:27.372734 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:27.372368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:27.372734 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:27.372414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:27.372734 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:27.372526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:28.372495 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:28.372456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:28.372931 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:28.372598 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:29.372436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:29.372404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:29.372624 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:29.372542 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:29.373004 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:29.372915 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:29.373063 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:29.373012 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:30.371982 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:30.371943 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:30.372164 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:30.372055 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:30.968889 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:30.968855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:30.969350 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:30.968898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:30.969350 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:30.969008 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:30.969350 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:30.969017 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:30.969350 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:30.969063 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:21:46.96904501 +0000 UTC m=+35.876125650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:30.969350 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:30.969079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:21:46.969072794 +0000 UTC m=+35.876153432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:31.069914 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:31.069879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:31.070071 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:31.070008 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:31.070071 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:31.070055 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:31.070071 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:31.070068 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:31.070195 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:31.070130 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:21:47.07011738 +0000 UTC m=+35.977198024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:31.376124 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:31.376047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:31.376266 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:31.376153 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:31.376266 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:31.376212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:31.376359 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:31.376326 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:32.372871 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:32.372833 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:32.373328 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:32.372962 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:33.373964 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:33.373732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:33.373964 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:33.373850 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:33.373964 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:33.373895 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:33.373964 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:33.373922 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:34.372506 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.372083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:34.372506 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:34.372459 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:34.580408 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.580218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"f5ab2312ed81bd2bb840713692bf9de0a7a891a30063b2b59a39c1befaa45c53"} Sep 18 13:21:34.581191 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.580463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"da32955d6d7eff4ea9c066c2b5c9b63c3a059dc0c2e41bc777028bea4931ffde"} Sep 18 13:21:34.581191 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.580505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"3a6489021cd86bd0c6561f0b6e4e3e0b8bb9f3785515c0afa52a14f77b535279"} Sep 18 13:21:34.581191 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.580540 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"88ff9dae44e927e1736817777f3dfd0adbaa6a319fb1caf8d52fb05e8982671e"} Sep 18 13:21:34.581910 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.581885 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ts5zr" event={"ID":"c44dc0a0-9161-48e0-afae-adbb470c819d","Type":"ContainerStarted","Data":"c6c9a9639a3f1221f749b012ce88a9b6c16995cf11ffd50a5a1f264dfcccf701"} Sep 18 13:21:34.583487 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.583465 2563 generic.go:356] "Generic (PLEG): container finished" podID="8432a36c-65d6-4aa0-a995-12f6bdb53113" containerID="5a8676dbacf3ee74940c07fbdc2a1acca43d21a197a270fbd52f12b2ce9fde58" exitCode=0 Sep 18 13:21:34.583559 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.583538 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerDied","Data":"5a8676dbacf3ee74940c07fbdc2a1acca43d21a197a270fbd52f12b2ce9fde58"} Sep 18 13:21:34.584946 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.584925 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" event={"ID":"dab052e0-0cda-4e03-a4c3-dd04034edd02","Type":"ContainerStarted","Data":"d9ce479e63c298e567950fae8e1ca907af8b0341ee535e8eb7fdcf3c53644ffa"} Sep 18 13:21:34.586402 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.586374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s8ppl" event={"ID":"6a6e5ed1-5978-4c60-b6eb-2b86749d34fc","Type":"ContainerStarted","Data":"1926a27286993516e1105c8f59dcbc73790955db1f2ccc9e28f807473e9ebb79"} Sep 18 13:21:34.587800 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.587776 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jwgfh" event={"ID":"5b5996a5-2a7d-4702-8837-0c1d63b28b29","Type":"ContainerStarted","Data":"70e1ae010555d6d9fc982ddfb305c00852e3bdc81e2f423292e1ac7da09858b7"} Sep 18 13:21:34.589223 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.589204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnqlz" event={"ID":"f762345d-70e3-46d9-a52d-477f85f73b46","Type":"ContainerStarted","Data":"ee9466cacc7546fb6385d63d603d0bf6709f0f4803438b7c75d7026e517308b8"} Sep 18 13:21:34.590532 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.590514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" event={"ID":"d4ab57bd-e909-439c-8bef-dee757001f1c","Type":"ContainerStarted","Data":"2bf0ef40a3f119b2084334ce7fb136a73df790f6d4c9ed02e30f72dc4d4a75f5"} Sep 18 13:21:34.606509 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.606460 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ts5zr" podStartSLOduration=3.7881949969999997 podStartE2EDuration="21.60644176s" totalImagesPullingTime="17.818246763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:34.606127353 +0000 UTC m=+23.513208008" watchObservedRunningTime="2026-09-18 13:21:34.60644176 +0000 UTC m=+23.513522422" Sep 18 13:21:34.606929 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.606897 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" podStartSLOduration=20.606885304 podStartE2EDuration="20.606885304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:18.585648723 +0000 UTC m=+7.492729384" watchObservedRunningTime="2026-09-18 13:21:34.606885304 +0000 UTC m=+23.513965967" Sep 18 13:21:34.697343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.697303 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s8ppl" podStartSLOduration=11.553576815 podStartE2EDuration="21.69728867s" totalImagesPullingTime="10.143711855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:34.696879327 +0000 UTC m=+23.603959988" watchObservedRunningTime="2026-09-18 13:21:34.69728867 +0000 UTC m=+23.604369331" Sep 18 13:21:34.697653 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.697634 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bbgnk" podStartSLOduration=3.930899349 podStartE2EDuration="21.697628497s" totalImagesPullingTime="17.766729148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:34.670790759 +0000 UTC m=+23.577871421" watchObservedRunningTime="2026-09-18 13:21:34.697628497 +0000 UTC m=+23.604709157" Sep 18 13:21:34.719445 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.719398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jwgfh" podStartSLOduration=3.972573442 podStartE2EDuration="21.719385982s" totalImagesPullingTime="17.74681254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:34.719322126 +0000 UTC m=+23.626402787" watchObservedRunningTime="2026-09-18 13:21:34.719385982 +0000 UTC m=+23.626466642" Sep 18 13:21:34.740943 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:34.740899 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lnqlz" podStartSLOduration=3.997522903 podStartE2EDuration="21.740886184s" totalImagesPullingTime="17.743363281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:34.740328635 +0000 UTC m=+23.647409296" watchObservedRunningTime="2026-09-18 13:21:34.740886184 +0000 UTC m=+23.647966844" Sep 18 13:21:35.372989 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.372960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:35.373148 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:35.373100 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:35.373429 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.373404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:35.373531 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:35.373470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:35.453696 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.453640 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 13:21:35.596179 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.596140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"df74ead60e060aa521ec8ec9383a96c600650d1bd21793dd642812acbb0d1100"} Sep 18 13:21:35.596670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.596238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"9d6368ef23da4ef16b35868102bb2ab8d2edf9c69e7eb5a56b9badf87f13d99b"} Sep 18 13:21:35.597861 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.597835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5chn" event={"ID":"fb5f590f-bc75-41e9-8192-61f250e5d139","Type":"ContainerStarted","Data":"d4e95f171a8798f39bd7cce92f906c31b05f0cfee6f41ae2157b0bed0aaed441"} Sep 18 13:21:35.600755 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:35.600726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" event={"ID":"dab052e0-0cda-4e03-a4c3-dd04034edd02","Type":"ContainerStarted","Data":"c1653de7b6e50dae21c6c4f3269bfc5f2f93eaa89e22d85fdddb8729315dc1f4"} Sep 18 13:21:36.302227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.302126 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:21:35.453660459Z","UUID":"2179dcf6-ae85-4f1e-ad5a-9faabab64f05","Handler":null,"Name":"","Endpoint":""} Sep 18 13:21:36.303894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.303873 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 13:21:36.304022 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.303907 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 13:21:36.372694 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.372653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:36.372807 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:36.372788 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:36.606137 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.605996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" event={"ID":"dab052e0-0cda-4e03-a4c3-dd04034edd02","Type":"ContainerStarted","Data":"2a670517a9edacac90ebab476412aee2fff0f4fcba8761e5abc1f74c5a6049aa"} Sep 18 13:21:36.630887 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.630836 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f64tv" podStartSLOduration=4.051080908 podStartE2EDuration="23.630821746s" totalImagesPullingTime="19.579740838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:36.630747504 +0000 UTC m=+25.537828168" watchObservedRunningTime="2026-09-18 13:21:36.630821746 +0000 UTC m=+25.537902407" Sep 18 13:21:36.633149 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:36.631294 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s5chn" podStartSLOduration=5.887638944 podStartE2EDuration="23.631248437s" totalImagesPullingTime="17.743609493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:35.618460189 +0000 UTC m=+24.525540851" watchObservedRunningTime="2026-09-18 13:21:36.631248437 +0000 UTC m=+25.538329100" Sep 18 13:21:37.372092 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:37.372063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:37.372260 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:37.372069 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:37.372260 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:37.372207 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:37.372383 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:37.372256 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:37.612571 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:37.612533 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"197b0fe88954f35211481a26ea7bb4daf912192f35aeb82e75a48b2f4aa62f30"} Sep 18 13:21:37.727748 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:37.727716 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:37.728486 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:37.728461 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:38.372326 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:38.372114 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:38.372527 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:38.372434 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:38.616626 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:38.616601 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:38.617128 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:38.617104 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s8ppl" Sep 18 13:21:39.373025 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:39.372799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:39.373142 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:39.372799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:39.373142 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:39.373075 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:39.373223 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:39.373145 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:39.619367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:39.619332 2563 generic.go:356] "Generic (PLEG): container finished" podID="8432a36c-65d6-4aa0-a995-12f6bdb53113" containerID="fb9e27466f7fc2adeb4aa39d325f6986874ba60ac4a92876d6d17bb2084d62dc" exitCode=0 Sep 18 13:21:39.620300 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:39.619415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerDied","Data":"fb9e27466f7fc2adeb4aa39d325f6986874ba60ac4a92876d6d17bb2084d62dc"} Sep 18 13:21:39.623481 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:39.623420 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" event={"ID":"bd3adf38-4873-4761-a02b-16102f508c23","Type":"ContainerStarted","Data":"78f1b147d6f19a20ff137e5baf1680bb22fb52caf91c52a43fba4715f2cac7e7"} Sep 18 13:21:39.689177 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:39.689134 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" podStartSLOduration=8.897332572 podStartE2EDuration="26.689121473s" totalImagesPullingTime="17.791788901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:39.688657874 +0000 UTC m=+28.595738534" watchObservedRunningTime="2026-09-18 13:21:39.689121473 +0000 UTC m=+28.596202135" Sep 18 13:21:40.372114 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.372083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:40.372387 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:40.372199 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:40.625531 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.625473 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:21:40.625999 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.625977 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:40.626080 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.626067 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:40.641330 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.641306 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:40.641742 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.641717 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:40.924867 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.924841 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hptsl"] Sep 18 13:21:40.924989 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.924969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:40.925133 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:40.925109 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:40.930016 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.929994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnvc5"] Sep 18 13:21:40.930132 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.930079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:40.930194 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:40.930174 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:40.939376 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.939356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4swtf"] Sep 18 13:21:40.939474 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:40.939451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:40.939582 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:40.939528 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:41.630343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:41.630302 2563 generic.go:356] "Generic (PLEG): container finished" podID="8432a36c-65d6-4aa0-a995-12f6bdb53113" containerID="6151f06deb7bab30028373b3dc0680de6cf470e64d35584ee619d7a95b47e869" exitCode=0 Sep 18 13:21:41.631143 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:41.631122 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:21:41.633344 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:41.633237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerDied","Data":"6151f06deb7bab30028373b3dc0680de6cf470e64d35584ee619d7a95b47e869"} Sep 18 13:21:42.372115 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:42.372081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:42.372274 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:42.372216 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:42.372274 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:42.372262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:42.372389 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:42.372358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:42.633506 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:42.633475 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:21:43.375144 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:43.375086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:43.375260 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:43.375174 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:43.638146 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:43.638105 2563 generic.go:356] "Generic (PLEG): container finished" podID="8432a36c-65d6-4aa0-a995-12f6bdb53113" containerID="35d8b90167dff735d288ddc0eb4db9c6bc0c03a5775d4b44168383b6fc67c3a9" exitCode=0 Sep 18 13:21:43.638515 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:43.638185 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerDied","Data":"35d8b90167dff735d288ddc0eb4db9c6bc0c03a5775d4b44168383b6fc67c3a9"} Sep 18 13:21:44.332605 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:44.332353 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:21:44.332890 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:44.332875 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 13:21:44.349844 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:44.349800 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" podUID="bd3adf38-4873-4761-a02b-16102f508c23" containerName="ovnkube-controller" probeResult="failure" output="" Sep 18 13:21:44.360160 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:44.360125 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" podUID="bd3adf38-4873-4761-a02b-16102f508c23" containerName="ovnkube-controller" probeResult="failure" output="" Sep 18 13:21:44.372552 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:44.372526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:44.372552 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:44.372554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:44.372746 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:44.372639 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:44.372870 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:44.372797 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:45.376139 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:45.376072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:45.376521 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:45.376170 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnvc5" podUID="a38650e3-2986-4c1f-a83b-9559ae7fbcff" Sep 18 13:21:46.372208 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.372166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:46.372505 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:46.372314 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4swtf" podUID="07fcd93d-fec2-45ad-8a6c-6bae73e274fe" Sep 18 13:21:46.372505 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.372357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:46.372616 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:46.372495 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hptsl" podUID="d91a8ab9-e813-4d4f-b76c-87c102b623bc" Sep 18 13:21:46.820380 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.820341 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeReady" Sep 18 13:21:46.820835 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.820498 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 13:21:46.870465 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.870432 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t88fv"] Sep 18 13:21:46.900841 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.900805 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vlx6c"] Sep 18 13:21:46.900985 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.900952 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:46.905274 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.905243 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 13:21:46.906230 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.906018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 13:21:46.906447 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.906419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cl5bn\"" Sep 18 13:21:46.919656 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.919634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t88fv"] Sep 18 13:21:46.919774 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.919694 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlx6c"] Sep 18 13:21:46.919815 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.919771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:46.923010 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.922708 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 13:21:46.923010 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.922784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l4mm5\"" Sep 18 13:21:46.923131 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.923088 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 13:21:46.923705 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.923670 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 13:21:46.989014 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.988977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:46.989181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b356376-6131-45ec-96cf-32ccebf858c4-config-volume\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:46.989181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b1e2214-b651-428e-9d33-63ab32e00730-cert\") pod \"ingress-canary-vlx6c\" (UID: \"4b1e2214-b651-428e-9d33-63ab32e00730\") " pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:46.989181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckxs\" (UniqueName: \"kubernetes.io/projected/7b356376-6131-45ec-96cf-32ccebf858c4-kube-api-access-dckxs\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:46.989181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjnx\" (UniqueName: \"kubernetes.io/projected/4b1e2214-b651-428e-9d33-63ab32e00730-kube-api-access-7rjnx\") pod \"ingress-canary-vlx6c\" (UID: \"4b1e2214-b651-428e-9d33-63ab32e00730\") " pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:46.989181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b356376-6131-45ec-96cf-32ccebf858c4-tmp-dir\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:46.989181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:46.989428 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:46.989224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:46.989428 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:46.989368 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:46.989428 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:46.989427 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret podName:a38650e3-2986-4c1f-a83b-9559ae7fbcff nodeName:}" failed. No retries permitted until 2026-09-18 13:22:18.989408396 +0000 UTC m=+67.896489041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret") pod "global-pull-secret-syncer-rnvc5" (UID: "a38650e3-2986-4c1f-a83b-9559ae7fbcff") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:21:46.989906 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:46.989869 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:46.989974 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:46.989935 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:22:18.989919357 +0000 UTC m=+67.897000016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:21:47.090390 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.090362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b356376-6131-45ec-96cf-32ccebf858c4-config-volume\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.090582 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.090398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b1e2214-b651-428e-9d33-63ab32e00730-cert\") pod \"ingress-canary-vlx6c\" (UID: \"4b1e2214-b651-428e-9d33-63ab32e00730\") " pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:47.090582 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.090430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckxs\" (UniqueName: \"kubernetes.io/projected/7b356376-6131-45ec-96cf-32ccebf858c4-kube-api-access-dckxs\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.090582 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.090451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjnx\" (UniqueName: \"kubernetes.io/projected/4b1e2214-b651-428e-9d33-63ab32e00730-kube-api-access-7rjnx\") pod \"ingress-canary-vlx6c\" (UID: \"4b1e2214-b651-428e-9d33-63ab32e00730\") " pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:47.090923 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.090891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b356376-6131-45ec-96cf-32ccebf858c4-tmp-dir\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.091050 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.090976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.091050 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.091006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:47.091050 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.091031 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b356376-6131-45ec-96cf-32ccebf858c4-config-volume\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.091194 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.091118 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:21:47.091194 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.091129 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:21:47.091194 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.091132 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:21:47.091194 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.091149 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tnl4q for pod openshift-network-diagnostics/network-check-target-4swtf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:47.091194 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.091183 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:21:47.591164571 +0000 UTC m=+36.498245217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:21:47.091370 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.091204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q podName:07fcd93d-fec2-45ad-8a6c-6bae73e274fe nodeName:}" failed. No retries permitted until 2026-09-18 13:22:19.091190271 +0000 UTC m=+67.998270911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnl4q" (UniqueName: "kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q") pod "network-check-target-4swtf" (UID: "07fcd93d-fec2-45ad-8a6c-6bae73e274fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:21:47.091370 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.091256 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b356376-6131-45ec-96cf-32ccebf858c4-tmp-dir\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.095114 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.095093 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b1e2214-b651-428e-9d33-63ab32e00730-cert\") pod \"ingress-canary-vlx6c\" (UID: \"4b1e2214-b651-428e-9d33-63ab32e00730\") " pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:47.101808 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.101783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckxs\" (UniqueName: \"kubernetes.io/projected/7b356376-6131-45ec-96cf-32ccebf858c4-kube-api-access-dckxs\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.103428 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.103400 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjnx\" (UniqueName: \"kubernetes.io/projected/4b1e2214-b651-428e-9d33-63ab32e00730-kube-api-access-7rjnx\") pod \"ingress-canary-vlx6c\" (UID: \"4b1e2214-b651-428e-9d33-63ab32e00730\") " pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:47.229597 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.229526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlx6c" Sep 18 13:21:47.372194 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.372158 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:21:47.375981 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.375949 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:21:47.596023 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.595940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:47.596179 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.596094 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:21:47.596179 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:47.596171 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:21:48.596151706 +0000 UTC m=+37.503232362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:21:47.902623 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:47.902468 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlx6c"] Sep 18 13:21:47.906591 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:21:47.906563 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1e2214_b651_428e_9d33_63ab32e00730.slice/crio-13bc8ce238ae2ce5968e8860d4f5b536175b9b3cc502ef2d712216fe3ae744ae WatchSource:0}: Error finding container 13bc8ce238ae2ce5968e8860d4f5b536175b9b3cc502ef2d712216fe3ae744ae: Status 404 returned error can't find the container with id 13bc8ce238ae2ce5968e8860d4f5b536175b9b3cc502ef2d712216fe3ae744ae Sep 18 13:21:48.371901 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.371869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:21:48.372083 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.372062 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:21:48.374862 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.374842 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:21:48.374964 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.374843 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:21:48.375136 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.375123 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:21:48.376202 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.376189 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vpkk2\"" Sep 18 13:21:48.376262 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.376246 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-br5gh\"" Sep 18 13:21:48.602373 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.602341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:48.602559 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:48.602525 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:21:48.602620 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:48.602596 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:21:50.602581591 +0000 UTC m=+39.509662242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:21:48.651600 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.651552 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlx6c" event={"ID":"4b1e2214-b651-428e-9d33-63ab32e00730","Type":"ContainerStarted","Data":"13bc8ce238ae2ce5968e8860d4f5b536175b9b3cc502ef2d712216fe3ae744ae"} Sep 18 13:21:48.654714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.654670 2563 generic.go:356] "Generic (PLEG): container finished" podID="8432a36c-65d6-4aa0-a995-12f6bdb53113" containerID="a5cf939dcf12cda41d0f0b0fb50030c3ef645da7476a37e9e9469b2a6e333fc0" exitCode=0 Sep 18 13:21:48.654842 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:48.654735 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerDied","Data":"a5cf939dcf12cda41d0f0b0fb50030c3ef645da7476a37e9e9469b2a6e333fc0"} Sep 18 13:21:49.661432 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:49.661391 2563 generic.go:356] "Generic (PLEG): container finished" podID="8432a36c-65d6-4aa0-a995-12f6bdb53113" containerID="028d8ddaeff2431e9c505d0ad46dcd01fc44303c30dd21f2e5353621a7690b0f" exitCode=0 Sep 18 13:21:49.661881 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:49.661450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerDied","Data":"028d8ddaeff2431e9c505d0ad46dcd01fc44303c30dd21f2e5353621a7690b0f"} Sep 18 13:21:50.617507 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:50.617469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:50.617640 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:50.617620 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:21:50.617716 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:50.617692 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:21:54.617662202 +0000 UTC m=+43.524742841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:21:50.665942 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:50.665901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlx6c" event={"ID":"4b1e2214-b651-428e-9d33-63ab32e00730","Type":"ContainerStarted","Data":"5226a374bc5b1eaf674087c8748b994f3118ead7a52d2c951ad0d79decdbc2f7"} Sep 18 13:21:50.669803 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:50.669779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64xdc" event={"ID":"8432a36c-65d6-4aa0-a995-12f6bdb53113","Type":"ContainerStarted","Data":"eeee9b5fae06db6d00e60162741e2616c311bac0d21c842d8cd00c0438eb30ac"} Sep 18 13:21:50.683546 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:50.683498 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vlx6c" podStartSLOduration=2.075433367 podStartE2EDuration="4.683483865s" totalImagesPullingTime="2.608050498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:50.683229983 +0000 UTC m=+39.590310644" watchObservedRunningTime="2026-09-18 13:21:50.683483865 +0000 UTC m=+39.590564525" Sep 18 13:21:50.712498 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:50.712431 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-64xdc" podStartSLOduration=9.153905887 podStartE2EDuration="37.71240993s" totalImagesPullingTime="28.558504043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:50.711133723 +0000 UTC m=+39.618214395" watchObservedRunningTime="2026-09-18 13:21:50.71240993 +0000 UTC m=+39.619490591" Sep 18 13:21:54.645971 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:21:54.645789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:21:54.646382 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:54.645939 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:21:54.646382 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:21:54.646083 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:02.646068869 +0000 UTC m=+51.553149509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:22:02.697371 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:02.697338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:22:02.697767 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:02.697450 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:22:02.697767 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:02.697497 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:18.697485171 +0000 UTC m=+67.604565811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:22:14.359796 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:14.359763 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfhfl" Sep 18 13:22:15.877005 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.876975 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd"] Sep 18 13:22:15.879608 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.879591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:15.884414 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.884335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 13:22:15.884717 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.884698 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c7bs5\"" Sep 18 13:22:15.884811 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.884762 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 13:22:15.885470 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.885437 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:22:15.885970 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.885916 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 13:22:15.886212 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.886190 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-56jh2"] Sep 18 13:22:15.887848 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.887834 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:15.895106 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.895091 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 13:22:15.895106 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.895101 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 13:22:15.895257 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.895176 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:22:15.895313 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.895290 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ktt2v\"" Sep 18 13:22:15.895365 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.895318 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 13:22:15.900533 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.900509 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 13:22:15.922151 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.922132 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-56jh2"] Sep 18 13:22:15.955017 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.954991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd"] Sep 18 13:22:15.965442 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.965420 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-5d2bt"] Sep 18 13:22:15.967209 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.967191 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:15.983106 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.983089 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 13:22:15.983286 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.983275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 18 13:22:15.983787 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.983775 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 18 13:22:15.983855 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.983837 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tcgg7\"" Sep 18 13:22:15.984037 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.984024 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 13:22:15.984795 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.984779 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 18 13:22:15.988095 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04d37d2e-920f-438a-9164-83583ea3db84-config\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:15.988197 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/851f068d-7236-45c4-a155-7a16c9f0f47b-config\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:15.988197 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d37d2e-920f-438a-9164-83583ea3db84-trusted-ca\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:15.988197 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tc4d\" (UniqueName: \"kubernetes.io/projected/04d37d2e-920f-438a-9164-83583ea3db84-kube-api-access-6tc4d\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:15.988197 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/851f068d-7236-45c4-a155-7a16c9f0f47b-serving-cert\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:15.988197 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04d37d2e-920f-438a-9164-83583ea3db84-serving-cert\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:15.988438 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.988208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlrfd\" (UniqueName: \"kubernetes.io/projected/851f068d-7236-45c4-a155-7a16c9f0f47b-kube-api-access-dlrfd\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:15.989938 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:15.989915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-5d2bt"] Sep 18 13:22:16.089300 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-tmp\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.089477 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089316 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnzgd\" (UniqueName: \"kubernetes.io/projected/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-kube-api-access-gnzgd\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.089477 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04d37d2e-920f-438a-9164-83583ea3db84-config\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.089477 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/851f068d-7236-45c4-a155-7a16c9f0f47b-config\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.089635 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-snapshots\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.089635 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d37d2e-920f-438a-9164-83583ea3db84-trusted-ca\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.089635 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tc4d\" (UniqueName: \"kubernetes.io/projected/04d37d2e-920f-438a-9164-83583ea3db84-kube-api-access-6tc4d\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.089635 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.089635 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.089572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/851f068d-7236-45c4-a155-7a16c9f0f47b-serving-cert\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.090022 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.090000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04d37d2e-920f-438a-9164-83583ea3db84-serving-cert\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.090168 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.090151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlrfd\" (UniqueName: \"kubernetes.io/projected/851f068d-7236-45c4-a155-7a16c9f0f47b-kube-api-access-dlrfd\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.090350 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.090194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.090476 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.090454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/851f068d-7236-45c4-a155-7a16c9f0f47b-config\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.090548 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.090383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-serving-cert\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.093541 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.091002 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04d37d2e-920f-438a-9164-83583ea3db84-config\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.094315 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.094295 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d37d2e-920f-438a-9164-83583ea3db84-trusted-ca\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.095333 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.095313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/851f068d-7236-45c4-a155-7a16c9f0f47b-serving-cert\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.095418 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.095354 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04d37d2e-920f-438a-9164-83583ea3db84-serving-cert\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.101219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.101197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlrfd\" (UniqueName: \"kubernetes.io/projected/851f068d-7236-45c4-a155-7a16c9f0f47b-kube-api-access-dlrfd\") pod \"service-ca-operator-57cdc4b768-jrpwd\" (UID: \"851f068d-7236-45c4-a155-7a16c9f0f47b\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.101322 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.101297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tc4d\" (UniqueName: \"kubernetes.io/projected/04d37d2e-920f-438a-9164-83583ea3db84-kube-api-access-6tc4d\") pod \"console-operator-fd4bb46c-56jh2\" (UID: \"04d37d2e-920f-438a-9164-83583ea3db84\") " pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.188541 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.188506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" Sep 18 13:22:16.191195 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnzgd\" (UniqueName: \"kubernetes.io/projected/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-kube-api-access-gnzgd\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.191354 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-snapshots\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.191354 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.191354 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.191354 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-serving-cert\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.191354 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-tmp\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.192519 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191814 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-tmp\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.192519 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.191859 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-snapshots\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.192519 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.192004 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.192519 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.192189 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.193786 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.193768 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-serving-cert\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.195759 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.195738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:16.200975 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.200947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnzgd\" (UniqueName: \"kubernetes.io/projected/20fb5c48-58fd-48b3-ac86-0c46e8432bc4-kube-api-access-gnzgd\") pod \"insights-operator-6f9c644dd9-5d2bt\" (UID: \"20fb5c48-58fd-48b3-ac86-0c46e8432bc4\") " pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.276103 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.276044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" Sep 18 13:22:16.465971 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.465946 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd"] Sep 18 13:22:16.467824 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.467804 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-56jh2"] Sep 18 13:22:16.468022 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:16.468003 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851f068d_7236_45c4_a155_7a16c9f0f47b.slice/crio-fc73c5409d30bf49bd1308fcbaea382cbb0e301b8ac307fc7d61dd63e171b917 WatchSource:0}: Error finding container fc73c5409d30bf49bd1308fcbaea382cbb0e301b8ac307fc7d61dd63e171b917: Status 404 returned error can't find the container with id fc73c5409d30bf49bd1308fcbaea382cbb0e301b8ac307fc7d61dd63e171b917 Sep 18 13:22:16.469668 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:16.469645 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d37d2e_920f_438a_9164_83583ea3db84.slice/crio-1c90c646401fbc210fdcb36f9adc4139b917e0bd6029cb5e82371ad00bed61cc WatchSource:0}: Error finding container 1c90c646401fbc210fdcb36f9adc4139b917e0bd6029cb5e82371ad00bed61cc: Status 404 returned error can't find the container with id 1c90c646401fbc210fdcb36f9adc4139b917e0bd6029cb5e82371ad00bed61cc Sep 18 13:22:16.545274 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.545248 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-5d2bt"] Sep 18 13:22:16.548010 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:16.547991 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fb5c48_58fd_48b3_ac86_0c46e8432bc4.slice/crio-b72b2b8b7ca4f2777f326e6bcfeecbe6c3971f3572369fd43cf1590c8ebefa01 WatchSource:0}: Error finding container b72b2b8b7ca4f2777f326e6bcfeecbe6c3971f3572369fd43cf1590c8ebefa01: Status 404 returned error can't find the container with id b72b2b8b7ca4f2777f326e6bcfeecbe6c3971f3572369fd43cf1590c8ebefa01 Sep 18 13:22:16.730191 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.730113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" event={"ID":"04d37d2e-920f-438a-9164-83583ea3db84","Type":"ContainerStarted","Data":"1c90c646401fbc210fdcb36f9adc4139b917e0bd6029cb5e82371ad00bed61cc"} Sep 18 13:22:16.731216 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.731183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" event={"ID":"20fb5c48-58fd-48b3-ac86-0c46e8432bc4","Type":"ContainerStarted","Data":"b72b2b8b7ca4f2777f326e6bcfeecbe6c3971f3572369fd43cf1590c8ebefa01"} Sep 18 13:22:16.732256 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:16.732235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" event={"ID":"851f068d-7236-45c4-a155-7a16c9f0f47b","Type":"ContainerStarted","Data":"fc73c5409d30bf49bd1308fcbaea382cbb0e301b8ac307fc7d61dd63e171b917"} Sep 18 13:22:18.709514 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:18.709466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:22:18.709966 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:18.709621 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:22:18.709966 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:18.709709 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls podName:7b356376-6131-45ec-96cf-32ccebf858c4 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:50.709688102 +0000 UTC m=+99.616768754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls") pod "dns-default-t88fv" (UID: "7b356376-6131-45ec-96cf-32ccebf858c4") : secret "dns-default-metrics-tls" not found Sep 18 13:22:19.011799 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.011725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:22:19.011959 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.011820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:22:19.014767 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.014737 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:22:19.014914 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.014896 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:22:19.022120 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:19.022102 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 13:22:19.022205 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:19.022168 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs podName:d91a8ab9-e813-4d4f-b76c-87c102b623bc nodeName:}" failed. No retries permitted until 2026-09-18 13:23:23.022148392 +0000 UTC m=+131.929229046 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs") pod "network-metrics-daemon-hptsl" (UID: "d91a8ab9-e813-4d4f-b76c-87c102b623bc") : secret "metrics-daemon-secret" not found Sep 18 13:22:19.024228 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.024210 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38650e3-2986-4c1f-a83b-9559ae7fbcff-original-pull-secret\") pod \"global-pull-secret-syncer-rnvc5\" (UID: \"a38650e3-2986-4c1f-a83b-9559ae7fbcff\") " pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:22:19.112212 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.112185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:22:19.115595 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.115573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:22:19.125393 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.125375 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:22:19.135109 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.135090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnl4q\" (UniqueName: \"kubernetes.io/projected/07fcd93d-fec2-45ad-8a6c-6bae73e274fe-kube-api-access-tnl4q\") pod \"network-check-target-4swtf\" (UID: \"07fcd93d-fec2-45ad-8a6c-6bae73e274fe\") " pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:22:19.182320 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.182303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnvc5" Sep 18 13:22:19.286995 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.286932 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-br5gh\"" Sep 18 13:22:19.292283 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:19.292265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:22:20.082602 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.082532 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4swtf"] Sep 18 13:22:20.084659 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.084637 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnvc5"] Sep 18 13:22:20.085843 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:20.085816 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fcd93d_fec2_45ad_8a6c_6bae73e274fe.slice/crio-776f33403c4531af4ab02920a08c0e13632e24d0ebd459de7a2cd8a6497cbddb WatchSource:0}: Error finding container 776f33403c4531af4ab02920a08c0e13632e24d0ebd459de7a2cd8a6497cbddb: Status 404 returned error can't find the container with id 776f33403c4531af4ab02920a08c0e13632e24d0ebd459de7a2cd8a6497cbddb Sep 18 13:22:20.088314 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:20.088282 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38650e3_2986_4c1f_a83b_9559ae7fbcff.slice/crio-7326ce6447b39e58a6d3776fc7a0a5806d3af48c8c44e699a31e127f68558d3c WatchSource:0}: Error finding container 7326ce6447b39e58a6d3776fc7a0a5806d3af48c8c44e699a31e127f68558d3c: Status 404 returned error can't find the container with id 7326ce6447b39e58a6d3776fc7a0a5806d3af48c8c44e699a31e127f68558d3c Sep 18 13:22:20.747258 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.747209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" event={"ID":"20fb5c48-58fd-48b3-ac86-0c46e8432bc4","Type":"ContainerStarted","Data":"56872e8d2f207f487daa7cb9c917c1f71004c81ed0753e49353f904c6c323002"} Sep 18 13:22:20.749819 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.749784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" event={"ID":"851f068d-7236-45c4-a155-7a16c9f0f47b","Type":"ContainerStarted","Data":"8c7de86a992daa360655e5139e6b407c5477f335462564ae57fc4468c8ab3a4c"} Sep 18 13:22:20.752085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.752059 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4swtf" event={"ID":"07fcd93d-fec2-45ad-8a6c-6bae73e274fe","Type":"ContainerStarted","Data":"776f33403c4531af4ab02920a08c0e13632e24d0ebd459de7a2cd8a6497cbddb"} Sep 18 13:22:20.756331 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.755712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/0.log" Sep 18 13:22:20.756331 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.755746 2563 generic.go:356] "Generic (PLEG): container finished" podID="04d37d2e-920f-438a-9164-83583ea3db84" containerID="55b5163134133358340d13ba7919f246c2705930a1fe55009f9a2b2f73cb8b0d" exitCode=255 Sep 18 13:22:20.756331 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.755811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" event={"ID":"04d37d2e-920f-438a-9164-83583ea3db84","Type":"ContainerDied","Data":"55b5163134133358340d13ba7919f246c2705930a1fe55009f9a2b2f73cb8b0d"} Sep 18 13:22:20.756331 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.756068 2563 scope.go:117] "RemoveContainer" containerID="55b5163134133358340d13ba7919f246c2705930a1fe55009f9a2b2f73cb8b0d" Sep 18 13:22:20.759703 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.759590 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnvc5" event={"ID":"a38650e3-2986-4c1f-a83b-9559ae7fbcff","Type":"ContainerStarted","Data":"7326ce6447b39e58a6d3776fc7a0a5806d3af48c8c44e699a31e127f68558d3c"} Sep 18 13:22:20.775005 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.774458 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" podStartSLOduration=2.516535551 podStartE2EDuration="5.774440974s" totalImagesPullingTime="3.257905423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:20.773141134 +0000 UTC m=+69.680221798" watchObservedRunningTime="2026-09-18 13:22:20.774440974 +0000 UTC m=+69.681521636" Sep 18 13:22:20.818716 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:20.817541 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" podStartSLOduration=2.477412218 podStartE2EDuration="5.81752111s" totalImagesPullingTime="3.340108892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:20.815308561 +0000 UTC m=+69.722389224" watchObservedRunningTime="2026-09-18 13:22:20.81752111 +0000 UTC m=+69.724601773" Sep 18 13:22:21.103851 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.103767 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9"] Sep 18 13:22:21.109454 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.109428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" Sep 18 13:22:21.113367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.113078 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 13:22:21.113367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.113086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-trd4z\"" Sep 18 13:22:21.113565 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.113419 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 13:22:21.127877 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.125325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9"] Sep 18 13:22:21.231650 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.231611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxvm\" (UniqueName: \"kubernetes.io/projected/48e14527-b584-4bba-891f-aef2c99d89b7-kube-api-access-4mxvm\") pod \"migrator-76794cbd6c-ktqq9\" (UID: \"48e14527-b584-4bba-891f-aef2c99d89b7\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" Sep 18 13:22:21.332341 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.332168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxvm\" (UniqueName: \"kubernetes.io/projected/48e14527-b584-4bba-891f-aef2c99d89b7-kube-api-access-4mxvm\") pod \"migrator-76794cbd6c-ktqq9\" (UID: \"48e14527-b584-4bba-891f-aef2c99d89b7\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" Sep 18 13:22:21.340838 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.340811 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2dx6x"] Sep 18 13:22:21.344605 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.344141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.354795 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.353697 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 13:22:21.354795 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.353956 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cnhls\"" Sep 18 13:22:21.354795 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.354539 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 13:22:21.358630 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.358573 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxvm\" (UniqueName: \"kubernetes.io/projected/48e14527-b584-4bba-891f-aef2c99d89b7-kube-api-access-4mxvm\") pod \"migrator-76794cbd6c-ktqq9\" (UID: \"48e14527-b584-4bba-891f-aef2c99d89b7\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" Sep 18 13:22:21.363857 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.363755 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2dx6x"] Sep 18 13:22:21.430016 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.429986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" Sep 18 13:22:21.432576 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.432547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1263944-d7dd-4687-86d9-da9ddb4e0604-data-volume\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.432729 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.432588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.432729 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.432632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f1263944-d7dd-4687-86d9-da9ddb4e0604-crio-socket\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.432729 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.432702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.432885 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.432731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kb6z\" (UniqueName: \"kubernetes.io/projected/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-api-access-5kb6z\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.533390 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.533334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1263944-d7dd-4687-86d9-da9ddb4e0604-data-volume\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.533390 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.533385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.533592 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.533407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f1263944-d7dd-4687-86d9-da9ddb4e0604-crio-socket\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.533592 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.533445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.533592 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.533470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kb6z\" (UniqueName: \"kubernetes.io/projected/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-api-access-5kb6z\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.534098 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.534070 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f1263944-d7dd-4687-86d9-da9ddb4e0604-crio-socket\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.534246 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:21.534146 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:22:21.534246 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:21.534205 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:22.034186975 +0000 UTC m=+70.941267634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : configmap "kube-rbac-proxy" not found Sep 18 13:22:21.534433 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:21.534398 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:22:21.534485 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:21.534437 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:22.034424745 +0000 UTC m=+70.941505384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : secret "insights-runtime-extractor-tls" not found Sep 18 13:22:21.534758 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.534727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1263944-d7dd-4687-86d9-da9ddb4e0604-data-volume\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.544920 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.544865 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kb6z\" (UniqueName: \"kubernetes.io/projected/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-api-access-5kb6z\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:21.718276 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.718242 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9"] Sep 18 13:22:21.722457 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:21.722428 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e14527_b584_4bba_891f_aef2c99d89b7.slice/crio-38fdc2b4bac0c7f07d09c67d8ac1d90f4f10eab6a257fa6f2215c4ac61cdfb48 WatchSource:0}: Error finding container 38fdc2b4bac0c7f07d09c67d8ac1d90f4f10eab6a257fa6f2215c4ac61cdfb48: Status 404 returned error can't find the container with id 38fdc2b4bac0c7f07d09c67d8ac1d90f4f10eab6a257fa6f2215c4ac61cdfb48 Sep 18 13:22:21.765024 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.764999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/1.log" Sep 18 13:22:21.765946 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.765921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/0.log" Sep 18 13:22:21.766078 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.765967 2563 generic.go:356] "Generic (PLEG): container finished" podID="04d37d2e-920f-438a-9164-83583ea3db84" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" exitCode=255 Sep 18 13:22:21.766078 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.766046 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" event={"ID":"04d37d2e-920f-438a-9164-83583ea3db84","Type":"ContainerDied","Data":"169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2"} Sep 18 13:22:21.766187 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.766111 2563 scope.go:117] "RemoveContainer" containerID="55b5163134133358340d13ba7919f246c2705930a1fe55009f9a2b2f73cb8b0d" Sep 18 13:22:21.766321 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.766302 2563 scope.go:117] "RemoveContainer" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" Sep 18 13:22:21.766718 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:21.766475 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:21.768931 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:21.768655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" event={"ID":"48e14527-b584-4bba-891f-aef2c99d89b7","Type":"ContainerStarted","Data":"38fdc2b4bac0c7f07d09c67d8ac1d90f4f10eab6a257fa6f2215c4ac61cdfb48"} Sep 18 13:22:22.037359 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:22.037270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:22.037516 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:22.037357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:22.037516 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:22.037491 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:22:22.037635 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:22.037554 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:23.037535579 +0000 UTC m=+71.944616241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : secret "insights-runtime-extractor-tls" not found Sep 18 13:22:22.037832 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:22.037803 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:22:22.037972 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:22.037876 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:23.037858955 +0000 UTC m=+71.944939611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : configmap "kube-rbac-proxy" not found Sep 18 13:22:22.774040 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:22.773905 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/1.log" Sep 18 13:22:22.774714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:22.774691 2563 scope.go:117] "RemoveContainer" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" Sep 18 13:22:22.774924 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:22.774898 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:23.045581 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:23.045506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:23.045761 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:23.045590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:23.045761 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:23.045659 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:22:23.045761 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:23.045667 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:22:23.045761 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:23.045737 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:25.045722193 +0000 UTC m=+73.952802832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : configmap "kube-rbac-proxy" not found Sep 18 13:22:23.045761 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:23.045752 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:25.045746415 +0000 UTC m=+73.952827054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : secret "insights-runtime-extractor-tls" not found Sep 18 13:22:23.955620 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:23.955583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jwgfh_5b5996a5-2a7d-4702-8837-0c1d63b28b29/dns-node-resolver/0.log" Sep 18 13:22:24.129697 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.129649 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-nrpdw"] Sep 18 13:22:24.132881 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.132862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.135847 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.135827 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 13:22:24.135965 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.135833 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 13:22:24.137060 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.137044 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 13:22:24.137060 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.137050 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ncpxc\"" Sep 18 13:22:24.138048 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.138025 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 13:22:24.141761 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.141740 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-nrpdw"] Sep 18 13:22:24.154576 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.154552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vh8w\" (UniqueName: \"kubernetes.io/projected/1202ff02-22b1-4090-9e63-3bd063504be6-kube-api-access-5vh8w\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.154718 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.154643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1202ff02-22b1-4090-9e63-3bd063504be6-signing-cabundle\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.154718 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.154691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1202ff02-22b1-4090-9e63-3bd063504be6-signing-key\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.255937 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.255857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vh8w\" (UniqueName: \"kubernetes.io/projected/1202ff02-22b1-4090-9e63-3bd063504be6-kube-api-access-5vh8w\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.255937 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.255917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1202ff02-22b1-4090-9e63-3bd063504be6-signing-cabundle\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.256141 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.256122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1202ff02-22b1-4090-9e63-3bd063504be6-signing-key\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.256648 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.256619 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1202ff02-22b1-4090-9e63-3bd063504be6-signing-cabundle\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.259104 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.259082 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1202ff02-22b1-4090-9e63-3bd063504be6-signing-key\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.265968 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.265944 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vh8w\" (UniqueName: \"kubernetes.io/projected/1202ff02-22b1-4090-9e63-3bd063504be6-kube-api-access-5vh8w\") pod \"service-ca-55f6fc7b86-nrpdw\" (UID: \"1202ff02-22b1-4090-9e63-3bd063504be6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.444668 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.444628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" Sep 18 13:22:24.955693 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:24.955652 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnqlz_f762345d-70e3-46d9-a52d-477f85f73b46/node-ca/0.log" Sep 18 13:22:25.063428 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.063399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:25.063578 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.063460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:25.063578 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:25.063534 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:22:25.063578 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:25.063548 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:22:25.063670 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:25.063591 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:29.063575221 +0000 UTC m=+77.970655879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : configmap "kube-rbac-proxy" not found Sep 18 13:22:25.063670 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:25.063606 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:29.063598687 +0000 UTC m=+77.970679325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : secret "insights-runtime-extractor-tls" not found Sep 18 13:22:25.606099 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.606067 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-nrpdw"] Sep 18 13:22:25.609100 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:25.609074 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1202ff02_22b1_4090_9e63_3bd063504be6.slice/crio-c5bf552c8d1a2be0a68d0f0dc63b5da4d79a2e8e5e27dbec9dc42b294761c32c WatchSource:0}: Error finding container c5bf552c8d1a2be0a68d0f0dc63b5da4d79a2e8e5e27dbec9dc42b294761c32c: Status 404 returned error can't find the container with id c5bf552c8d1a2be0a68d0f0dc63b5da4d79a2e8e5e27dbec9dc42b294761c32c Sep 18 13:22:25.756575 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.756499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlx6c_4b1e2214-b651-428e-9d33-63ab32e00730/serve-healthcheck-canary/0.log" Sep 18 13:22:25.785025 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.784995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" event={"ID":"48e14527-b584-4bba-891f-aef2c99d89b7","Type":"ContainerStarted","Data":"83a5a75411585a32a60711a2336c5fc100c2fe66af7d082a1aeeea1d79f2a53c"} Sep 18 13:22:25.785190 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.785054 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" event={"ID":"48e14527-b584-4bba-891f-aef2c99d89b7","Type":"ContainerStarted","Data":"ca06feb360d968b62554483fded959fd7947d1e0ead20d7a71b0db601a09fc0c"} Sep 18 13:22:25.786646 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.786608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnvc5" event={"ID":"a38650e3-2986-4c1f-a83b-9559ae7fbcff","Type":"ContainerStarted","Data":"d2d396defdd063aed7625a580bc41be87990d7bde6a52d919cce2205bf232535"} Sep 18 13:22:25.788189 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.788162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" event={"ID":"1202ff02-22b1-4090-9e63-3bd063504be6","Type":"ContainerStarted","Data":"614697e7773f62eaba40ed6f12b90f36c0f5c3ce6f01df34c32e11bc4eace82e"} Sep 18 13:22:25.788292 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.788204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" event={"ID":"1202ff02-22b1-4090-9e63-3bd063504be6","Type":"ContainerStarted","Data":"c5bf552c8d1a2be0a68d0f0dc63b5da4d79a2e8e5e27dbec9dc42b294761c32c"} Sep 18 13:22:25.789652 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.789632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4swtf" event={"ID":"07fcd93d-fec2-45ad-8a6c-6bae73e274fe","Type":"ContainerStarted","Data":"04f1e277ea28068e41f105ad6ddb02139cdecaad7d7da33f8463d593371dac9b"} Sep 18 13:22:25.789765 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.789747 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:22:25.808210 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.805084 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ktqq9" podStartSLOduration=1.187116004 podStartE2EDuration="4.805067713s" totalImagesPullingTime="3.617951709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:25.802988596 +0000 UTC m=+74.710069269" watchObservedRunningTime="2026-09-18 13:22:25.805067713 +0000 UTC m=+74.712148375" Sep 18 13:22:25.823516 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.823476 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4swtf" podStartSLOduration=67.568727507 podStartE2EDuration="1m12.823462639s" totalImagesPullingTime="5.254735132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:25.822925398 +0000 UTC m=+74.730006050" watchObservedRunningTime="2026-09-18 13:22:25.823462639 +0000 UTC m=+74.730543299" Sep 18 13:22:25.840670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.840618 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-nrpdw" podStartSLOduration=1.8406042820000001 podStartE2EDuration="1.840604282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:25.840523336 +0000 UTC m=+74.747603998" watchObservedRunningTime="2026-09-18 13:22:25.840604282 +0000 UTC m=+74.747684944" Sep 18 13:22:25.856601 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:25.856562 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rnvc5" podStartSLOduration=67.588652737 podStartE2EDuration="1m12.856550947s" totalImagesPullingTime="5.26789821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:25.856108719 +0000 UTC m=+74.763189382" watchObservedRunningTime="2026-09-18 13:22:25.856550947 +0000 UTC m=+74.763631624" Sep 18 13:22:26.157578 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:26.157542 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ktqq9_48e14527-b584-4bba-891f-aef2c99d89b7/migrator/0.log" Sep 18 13:22:26.196641 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:26.196602 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:26.197145 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:26.197111 2563 scope.go:117] "RemoveContainer" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" Sep 18 13:22:26.197326 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:26.197295 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:26.197774 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:26.197753 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:26.359426 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:26.359403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ktqq9_48e14527-b584-4bba-891f-aef2c99d89b7/graceful-termination/0.log" Sep 18 13:22:26.796189 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:26.796156 2563 scope.go:117] "RemoveContainer" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" Sep 18 13:22:26.796358 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:26.796309 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:29.095006 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:29.094974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:29.095406 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:29.095024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:29.095406 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:29.095103 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:22:29.095406 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:29.095121 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:22:29.095406 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:29.095174 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:37.095156963 +0000 UTC m=+86.002237603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : secret "insights-runtime-extractor-tls" not found Sep 18 13:22:29.095406 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:29.095187 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm podName:f1263944-d7dd-4687-86d9-da9ddb4e0604 nodeName:}" failed. No retries permitted until 2026-09-18 13:22:37.095181053 +0000 UTC m=+86.002261692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dx6x" (UID: "f1263944-d7dd-4687-86d9-da9ddb4e0604") : configmap "kube-rbac-proxy" not found Sep 18 13:22:37.154725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.154667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:37.155196 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.154763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:37.155253 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.155223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1263944-d7dd-4687-86d9-da9ddb4e0604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:37.157336 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.157299 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1263944-d7dd-4687-86d9-da9ddb4e0604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dx6x\" (UID: \"f1263944-d7dd-4687-86d9-da9ddb4e0604\") " pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:37.257707 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.257659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2dx6x" Sep 18 13:22:37.555410 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.555323 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2dx6x"] Sep 18 13:22:37.559034 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:37.558947 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1263944_d7dd_4687_86d9_da9ddb4e0604.slice/crio-934c2521bb304b95e25e4d4aa28c68d4113b9e6b4cb468747b3e9efb6d9b96ec WatchSource:0}: Error finding container 934c2521bb304b95e25e4d4aa28c68d4113b9e6b4cb468747b3e9efb6d9b96ec: Status 404 returned error can't find the container with id 934c2521bb304b95e25e4d4aa28c68d4113b9e6b4cb468747b3e9efb6d9b96ec Sep 18 13:22:37.837539 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.837449 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dx6x" event={"ID":"f1263944-d7dd-4687-86d9-da9ddb4e0604","Type":"ContainerStarted","Data":"1d46e3498ac64984994c55aef764bf1de1f4bb4a0669432b2ee0f0e45d795c5f"} Sep 18 13:22:37.837539 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:37.837511 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dx6x" event={"ID":"f1263944-d7dd-4687-86d9-da9ddb4e0604","Type":"ContainerStarted","Data":"934c2521bb304b95e25e4d4aa28c68d4113b9e6b4cb468747b3e9efb6d9b96ec"} Sep 18 13:22:38.842772 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:38.842725 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dx6x" event={"ID":"f1263944-d7dd-4687-86d9-da9ddb4e0604","Type":"ContainerStarted","Data":"e3a765dd2329fb29b9a3862a223e546b9cae2274eb8906c492d707767b584cd2"} Sep 18 13:22:39.847719 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:39.847616 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dx6x" event={"ID":"f1263944-d7dd-4687-86d9-da9ddb4e0604","Type":"ContainerStarted","Data":"99c62e21f63d27d03da33c9891ca29ec860777a6f72942581482678050ac0d7a"} Sep 18 13:22:39.885735 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:39.885654 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2dx6x" podStartSLOduration=17.141817636 podStartE2EDuration="18.885634911s" totalImagesPullingTime="1.743817275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:22:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:39.88482375 +0000 UTC m=+88.791904421" watchObservedRunningTime="2026-09-18 13:22:39.885634911 +0000 UTC m=+88.792715572" Sep 18 13:22:41.373246 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.373208 2563 scope.go:117] "RemoveContainer" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" Sep 18 13:22:41.856294 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.856266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:22:41.856732 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.856718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/1.log" Sep 18 13:22:41.856809 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.856749 2563 generic.go:356] "Generic (PLEG): container finished" podID="04d37d2e-920f-438a-9164-83583ea3db84" containerID="da92f7e3f3465eb81fb1cff0f0547e8d37a2dcf121ef4875c5ac359ba326bf84" exitCode=255 Sep 18 13:22:41.856809 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.856802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" event={"ID":"04d37d2e-920f-438a-9164-83583ea3db84","Type":"ContainerDied","Data":"da92f7e3f3465eb81fb1cff0f0547e8d37a2dcf121ef4875c5ac359ba326bf84"} Sep 18 13:22:41.856877 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.856846 2563 scope.go:117] "RemoveContainer" containerID="169abf7e3e5a88a44e9889890ebe5c6e05eee741473633860b628edeb4f300e2" Sep 18 13:22:41.857223 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:41.857203 2563 scope.go:117] "RemoveContainer" containerID="da92f7e3f3465eb81fb1cff0f0547e8d37a2dcf121ef4875c5ac359ba326bf84" Sep 18 13:22:41.857362 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:41.857344 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:42.861154 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:42.861126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:22:45.466173 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.466139 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq"] Sep 18 13:22:45.468703 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.468667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.475571 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.475548 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 13:22:45.475663 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.475575 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 18 13:22:45.475663 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.475557 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 13:22:45.475663 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.475547 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 13:22:45.478645 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.478631 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bft9k\"" Sep 18 13:22:45.496115 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.496091 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq"] Sep 18 13:22:45.510809 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.510788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8fee1780-b4f6-40e2-9262-95765601751c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68644b5dfb-ssnmq\" (UID: \"8fee1780-b4f6-40e2-9262-95765601751c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.510918 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.510830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslhl\" (UniqueName: \"kubernetes.io/projected/8fee1780-b4f6-40e2-9262-95765601751c-kube-api-access-tslhl\") pod \"managed-serviceaccount-addon-agent-68644b5dfb-ssnmq\" (UID: \"8fee1780-b4f6-40e2-9262-95765601751c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.611765 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.611738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8fee1780-b4f6-40e2-9262-95765601751c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68644b5dfb-ssnmq\" (UID: \"8fee1780-b4f6-40e2-9262-95765601751c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.611918 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.611784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslhl\" (UniqueName: \"kubernetes.io/projected/8fee1780-b4f6-40e2-9262-95765601751c-kube-api-access-tslhl\") pod \"managed-serviceaccount-addon-agent-68644b5dfb-ssnmq\" (UID: \"8fee1780-b4f6-40e2-9262-95765601751c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.614554 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.614529 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8fee1780-b4f6-40e2-9262-95765601751c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68644b5dfb-ssnmq\" (UID: \"8fee1780-b4f6-40e2-9262-95765601751c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.631482 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.631456 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslhl\" (UniqueName: \"kubernetes.io/projected/8fee1780-b4f6-40e2-9262-95765601751c-kube-api-access-tslhl\") pod \"managed-serviceaccount-addon-agent-68644b5dfb-ssnmq\" (UID: \"8fee1780-b4f6-40e2-9262-95765601751c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.684886 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.684854 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56885fd79-nv7sr"] Sep 18 13:22:45.686893 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.686874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.693900 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.693884 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 13:22:45.694110 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.694098 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8fbv\"" Sep 18 13:22:45.694289 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.694277 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 13:22:45.696024 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.695990 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 13:22:45.701544 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.701525 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 13:22:45.730382 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.730320 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56885fd79-nv7sr"] Sep 18 13:22:45.786726 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.786702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" Sep 18 13:22:45.814325 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f64119-7f94-4fe0-8418-029bbbddae5a-ca-trust-extracted\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814465 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f64119-7f94-4fe0-8418-029bbbddae5a-installation-pull-secrets\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814465 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f64119-7f94-4fe0-8418-029bbbddae5a-registry-certificates\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814465 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f64119-7f94-4fe0-8418-029bbbddae5a-trusted-ca\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814644 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59nwc\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-kube-api-access-59nwc\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814644 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f64119-7f94-4fe0-8418-029bbbddae5a-image-registry-private-configuration\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814644 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-registry-tls\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.814644 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.814562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-bound-sa-token\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.915702 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f64119-7f94-4fe0-8418-029bbbddae5a-image-registry-private-configuration\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.915702 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-registry-tls\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.915938 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-bound-sa-token\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.915938 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f64119-7f94-4fe0-8418-029bbbddae5a-ca-trust-extracted\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.915938 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f64119-7f94-4fe0-8418-029bbbddae5a-installation-pull-secrets\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.915938 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f64119-7f94-4fe0-8418-029bbbddae5a-registry-certificates\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.916132 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.915991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f64119-7f94-4fe0-8418-029bbbddae5a-trusted-ca\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.916132 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.916053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59nwc\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-kube-api-access-59nwc\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.916227 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.916203 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f64119-7f94-4fe0-8418-029bbbddae5a-ca-trust-extracted\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.916611 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.916587 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f64119-7f94-4fe0-8418-029bbbddae5a-registry-certificates\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.917222 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.917198 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f64119-7f94-4fe0-8418-029bbbddae5a-trusted-ca\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.918504 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.918474 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f64119-7f94-4fe0-8418-029bbbddae5a-installation-pull-secrets\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.918585 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.918541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-registry-tls\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.918634 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.918596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f64119-7f94-4fe0-8418-029bbbddae5a-image-registry-private-configuration\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.939346 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.939325 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-bound-sa-token\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.944708 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.944666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59nwc\" (UniqueName: \"kubernetes.io/projected/e3f64119-7f94-4fe0-8418-029bbbddae5a-kube-api-access-59nwc\") pod \"image-registry-56885fd79-nv7sr\" (UID: \"e3f64119-7f94-4fe0-8418-029bbbddae5a\") " pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:45.995963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:45.995901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:46.109296 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.109269 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq"] Sep 18 13:22:46.118973 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:46.118950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fee1780_b4f6_40e2_9262_95765601751c.slice/crio-86ceb1e159fb9e419518b1e142db3da44939fca528ebb82068a14de7c016729a WatchSource:0}: Error finding container 86ceb1e159fb9e419518b1e142db3da44939fca528ebb82068a14de7c016729a: Status 404 returned error can't find the container with id 86ceb1e159fb9e419518b1e142db3da44939fca528ebb82068a14de7c016729a Sep 18 13:22:46.196343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.196317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:46.196468 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.196368 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:22:46.196753 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.196738 2563 scope.go:117] "RemoveContainer" containerID="da92f7e3f3465eb81fb1cff0f0547e8d37a2dcf121ef4875c5ac359ba326bf84" Sep 18 13:22:46.196920 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:46.196901 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:46.355348 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.355276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56885fd79-nv7sr"] Sep 18 13:22:46.358066 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:46.358038 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f64119_7f94_4fe0_8418_029bbbddae5a.slice/crio-4260fa7b26da808a19ea0569ab7454567cd2ab56a0a765f05bfc7dbabc7dbe44 WatchSource:0}: Error finding container 4260fa7b26da808a19ea0569ab7454567cd2ab56a0a765f05bfc7dbabc7dbe44: Status 404 returned error can't find the container with id 4260fa7b26da808a19ea0569ab7454567cd2ab56a0a765f05bfc7dbabc7dbe44 Sep 18 13:22:46.877241 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.877202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" event={"ID":"e3f64119-7f94-4fe0-8418-029bbbddae5a","Type":"ContainerStarted","Data":"ce316bc261c1cc881a81069a40ce3c39d2204bbac73dbec514b1109e3bc07634"} Sep 18 13:22:46.877717 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.877265 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" event={"ID":"e3f64119-7f94-4fe0-8418-029bbbddae5a","Type":"ContainerStarted","Data":"4260fa7b26da808a19ea0569ab7454567cd2ab56a0a765f05bfc7dbabc7dbe44"} Sep 18 13:22:46.877717 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.877307 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:22:46.878643 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.878617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" event={"ID":"8fee1780-b4f6-40e2-9262-95765601751c","Type":"ContainerStarted","Data":"86ceb1e159fb9e419518b1e142db3da44939fca528ebb82068a14de7c016729a"} Sep 18 13:22:46.931860 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:46.931806 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" podStartSLOduration=1.931786873 podStartE2EDuration="1.931786873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:46.930616753 +0000 UTC m=+95.837697413" watchObservedRunningTime="2026-09-18 13:22:46.931786873 +0000 UTC m=+95.838867537" Sep 18 13:22:48.887718 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:48.887662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" event={"ID":"8fee1780-b4f6-40e2-9262-95765601751c","Type":"ContainerStarted","Data":"7b274ba2ca4c01211cc6ec4f8c3f155e27f5a6f4824f05b3104f9432bcebbc67"} Sep 18 13:22:48.914975 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:48.914929 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68644b5dfb-ssnmq" podStartSLOduration=1.5904224550000001 podStartE2EDuration="3.914913657s" totalImagesPullingTime="2.324491202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:48.913375498 +0000 UTC m=+97.820456158" watchObservedRunningTime="2026-09-18 13:22:48.914913657 +0000 UTC m=+97.821994318" Sep 18 13:22:50.753559 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:50.753514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:22:50.755982 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:50.755961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b356376-6131-45ec-96cf-32ccebf858c4-metrics-tls\") pod \"dns-default-t88fv\" (UID: \"7b356376-6131-45ec-96cf-32ccebf858c4\") " pod="openshift-dns/dns-default-t88fv" Sep 18 13:22:50.819130 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:50.819099 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cl5bn\"" Sep 18 13:22:50.826892 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:50.826874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t88fv" Sep 18 13:22:51.128714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:51.128659 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t88fv"] Sep 18 13:22:51.133106 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:22:51.133080 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b356376_6131_45ec_96cf_32ccebf858c4.slice/crio-d12a4affc8c41b150491c64ff0adc5b085818c814c1410514d2b13d86fca8416 WatchSource:0}: Error finding container d12a4affc8c41b150491c64ff0adc5b085818c814c1410514d2b13d86fca8416: Status 404 returned error can't find the container with id d12a4affc8c41b150491c64ff0adc5b085818c814c1410514d2b13d86fca8416 Sep 18 13:22:51.903622 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:51.903580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t88fv" event={"ID":"7b356376-6131-45ec-96cf-32ccebf858c4","Type":"ContainerStarted","Data":"d12a4affc8c41b150491c64ff0adc5b085818c814c1410514d2b13d86fca8416"} Sep 18 13:22:53.912314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:53.912278 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t88fv" event={"ID":"7b356376-6131-45ec-96cf-32ccebf858c4","Type":"ContainerStarted","Data":"bc4c7aa30138ea6505d12776bf255d07ed0afce8d36c0fcf36ca8b9a80a4428c"} Sep 18 13:22:53.912719 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:53.912356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t88fv" event={"ID":"7b356376-6131-45ec-96cf-32ccebf858c4","Type":"ContainerStarted","Data":"46a7056909f0ca68e5d69599c9212b4e28ae5aaf4dec83d1a268f68639820692"} Sep 18 13:22:53.912719 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:53.912378 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t88fv" Sep 18 13:22:53.945089 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:53.945040 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t88fv" podStartSLOduration=65.732470703 podStartE2EDuration="1m7.945024336s" totalImagesPullingTime="2.212553633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:53.943156844 +0000 UTC m=+102.850237504" watchObservedRunningTime="2026-09-18 13:22:53.945024336 +0000 UTC m=+102.852104997" Sep 18 13:22:56.796977 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:56.796948 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4swtf" Sep 18 13:22:57.372609 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:57.372572 2563 scope.go:117] "RemoveContainer" containerID="da92f7e3f3465eb81fb1cff0f0547e8d37a2dcf121ef4875c5ac359ba326bf84" Sep 18 13:22:57.372821 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:57.372764 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-56jh2_openshift-console-operator(04d37d2e-920f-438a-9164-83583ea3db84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podUID="04d37d2e-920f-438a-9164-83583ea3db84" Sep 18 13:22:59.575786 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.575750 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xbdmf"] Sep 18 13:22:59.579063 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.579028 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.582866 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.582843 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 13:22:59.583215 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.582878 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 13:22:59.590892 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.590864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 13:22:59.591378 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.591361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 13:22:59.592142 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.591665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4h2dw\"" Sep 18 13:22:59.592142 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.591965 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 13:22:59.592142 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.591973 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 13:22:59.726987 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.726955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-textfile\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.726987 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.726986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e24e372-8f67-4049-abd0-daa8b131aae9-metrics-client-ca\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727200 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-wtmp\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727200 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727200 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-sys\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727200 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727190 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727349 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-tls\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727349 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2fhb\" (UniqueName: \"kubernetes.io/projected/8e24e372-8f67-4049-abd0-daa8b131aae9-kube-api-access-p2fhb\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.727349 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.727319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-root\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828639 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2fhb\" (UniqueName: \"kubernetes.io/projected/8e24e372-8f67-4049-abd0-daa8b131aae9-kube-api-access-p2fhb\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828639 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-root\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828670 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-root\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-textfile\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e24e372-8f67-4049-abd0-daa8b131aae9-metrics-client-ca\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-wtmp\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.828894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-sys\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829188 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829188 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.828954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-tls\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829188 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:59.829083 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 13:22:59.829188 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:22:59.829146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-tls podName:8e24e372-8f67-4049-abd0-daa8b131aae9 nodeName:}" failed. No retries permitted until 2026-09-18 13:23:00.329126714 +0000 UTC m=+109.236207357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-tls") pod "node-exporter-xbdmf" (UID: "8e24e372-8f67-4049-abd0-daa8b131aae9") : secret "node-exporter-tls" not found Sep 18 13:22:59.829188 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.829142 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-textfile\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829514 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.829492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-wtmp\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829756 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.829658 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829886 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.829718 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e24e372-8f67-4049-abd0-daa8b131aae9-sys\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.829993 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.829725 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e24e372-8f67-4049-abd0-daa8b131aae9-metrics-client-ca\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.831993 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.831973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:22:59.837654 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:22:59.837636 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2fhb\" (UniqueName: \"kubernetes.io/projected/8e24e372-8f67-4049-abd0-daa8b131aae9-kube-api-access-p2fhb\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:23:00.332718 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.332659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-tls\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:23:00.335144 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.335109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e24e372-8f67-4049-abd0-daa8b131aae9-node-exporter-tls\") pod \"node-exporter-xbdmf\" (UID: \"8e24e372-8f67-4049-abd0-daa8b131aae9\") " pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:23:00.498607 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.498577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xbdmf" Sep 18 13:23:00.507868 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:23:00.507831 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e24e372_8f67_4049_abd0_daa8b131aae9.slice/crio-952b2253e52bd687ed2ca3872f8f2347e193652163fa548619687f1bf9064896 WatchSource:0}: Error finding container 952b2253e52bd687ed2ca3872f8f2347e193652163fa548619687f1bf9064896: Status 404 returned error can't find the container with id 952b2253e52bd687ed2ca3872f8f2347e193652163fa548619687f1bf9064896 Sep 18 13:23:00.802326 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.802280 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:23:00.805439 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.805417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.822004 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.821982 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 13:23:00.822157 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.822099 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 13:23:00.822157 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.822103 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 13:23:00.822157 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.822133 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 13:23:00.822309 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.822105 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 13:23:00.822362 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.822345 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 13:23:00.822402 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.822345 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 13:23:00.823379 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.823366 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xv8lb\"" Sep 18 13:23:00.823460 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.823446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 13:23:00.835857 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.835835 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 13:23:00.936392 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.936704 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-web-config\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.936832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.936832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7gf\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-kube-api-access-sb7gf\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.936832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.936832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937098 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-out\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937098 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.936877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937098 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.937014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937098 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.937051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937287 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.937120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937287 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.937142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937287 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.937165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:00.937509 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.937480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbdmf" event={"ID":"8e24e372-8f67-4049-abd0-daa8b131aae9","Type":"ContainerStarted","Data":"952b2253e52bd687ed2ca3872f8f2347e193652163fa548619687f1bf9064896"} Sep 18 13:23:00.967360 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:00.967325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:23:01.038232 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-web-config\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038232 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7gf\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-kube-api-access-sb7gf\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-out\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038741 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038775 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038807 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038876 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.038930 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.038876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.039493 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.039368 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.040018 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.039951 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.040858 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.040826 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.042531 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.042075 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-out\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.042531 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.042489 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.042726 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.042598 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.042884 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.042840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-web-config\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.043294 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.043273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.043810 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.043786 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.043907 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.043812 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.043907 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.043859 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.044340 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.044320 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.061865 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.061818 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7gf\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-kube-api-access-sb7gf\") pod \"alertmanager-main-0\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.114764 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.114732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:23:01.450748 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.450725 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:23:01.453913 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:23:01.453891 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb2f46a_5883_4b76_a08f_0c32e2ef03c9.slice/crio-a3784d070b0cd060d06b00c90b3f146520e0171fc2ae02bb861df132d6931ac7 WatchSource:0}: Error finding container a3784d070b0cd060d06b00c90b3f146520e0171fc2ae02bb861df132d6931ac7: Status 404 returned error can't find the container with id a3784d070b0cd060d06b00c90b3f146520e0171fc2ae02bb861df132d6931ac7 Sep 18 13:23:01.947874 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.947819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"a3784d070b0cd060d06b00c90b3f146520e0171fc2ae02bb861df132d6931ac7"} Sep 18 13:23:01.949974 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.949947 2563 generic.go:356] "Generic (PLEG): container finished" podID="8e24e372-8f67-4049-abd0-daa8b131aae9" containerID="1526b3291746caaa5c6bb99c4a39f9b6b7465065b5b4e37fc151d226aa0cdf24" exitCode=0 Sep 18 13:23:01.950116 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:01.949991 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbdmf" event={"ID":"8e24e372-8f67-4049-abd0-daa8b131aae9","Type":"ContainerDied","Data":"1526b3291746caaa5c6bb99c4a39f9b6b7465065b5b4e37fc151d226aa0cdf24"} Sep 18 13:23:02.856045 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.855954 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d899dc46d-wjcf9"] Sep 18 13:23:02.858232 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.858214 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.863415 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.863380 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 13:23:02.863560 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.863488 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 13:23:02.863951 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.863932 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 13:23:02.865271 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.865250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 13:23:02.865550 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.865531 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gl4bl\"" Sep 18 13:23:02.865642 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.865549 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 13:23:02.865642 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.865554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fbe3ia6173i9b\"" Sep 18 13:23:02.877802 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.877783 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d899dc46d-wjcf9"] Sep 18 13:23:02.955390 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.955355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbdmf" event={"ID":"8e24e372-8f67-4049-abd0-daa8b131aae9","Type":"ContainerStarted","Data":"a2d48a3a9363014a067f5045ab3bdb381f772fe95260da93e8045856a248f707"} Sep 18 13:23:02.955850 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.955407 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbdmf" event={"ID":"8e24e372-8f67-4049-abd0-daa8b131aae9","Type":"ContainerStarted","Data":"2f67711e346b1679a6e62cd96eb6e7653d3029a45db60dd5d4ca4bc0e948504e"} Sep 18 13:23:02.956453 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-tls\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956556 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdk9k\" (UniqueName: \"kubernetes.io/projected/face2844-8901-42b7-a9e1-40854921ea56-kube-api-access-qdk9k\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956609 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-grpc-tls\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956609 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956740 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956740 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/face2844-8901-42b7-a9e1-40854921ea56-metrics-client-ca\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956817 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.956817 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.956799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:02.957218 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.957200 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4" exitCode=0 Sep 18 13:23:02.957271 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.957228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4"} Sep 18 13:23:02.998395 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:02.998339 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xbdmf" podStartSLOduration=2.996974766 podStartE2EDuration="3.998320078s" totalImagesPullingTime="932.528245ms" totalInitContainerRuntime="68.817067ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:02.995839149 +0000 UTC m=+111.902919811" watchObservedRunningTime="2026-09-18 13:23:02.998320078 +0000 UTC m=+111.905400741" Sep 18 13:23:03.057198 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.057159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-tls\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.057485 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.057459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdk9k\" (UniqueName: \"kubernetes.io/projected/face2844-8901-42b7-a9e1-40854921ea56-kube-api-access-qdk9k\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.057578 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.057504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-grpc-tls\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.057737 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.057713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.057901 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.057872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.057993 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.057976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/face2844-8901-42b7-a9e1-40854921ea56-metrics-client-ca\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.058101 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.058081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.058163 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.058119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.059395 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.059364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/face2844-8901-42b7-a9e1-40854921ea56-metrics-client-ca\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.060473 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.060450 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-tls\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.060689 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.060654 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-grpc-tls\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.060758 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.060737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.060965 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.060946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.061396 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.061374 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.061462 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.061447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/face2844-8901-42b7-a9e1-40854921ea56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.081245 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.081223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdk9k\" (UniqueName: \"kubernetes.io/projected/face2844-8901-42b7-a9e1-40854921ea56-kube-api-access-qdk9k\") pod \"thanos-querier-d899dc46d-wjcf9\" (UID: \"face2844-8901-42b7-a9e1-40854921ea56\") " pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.168006 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.167976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:03.467830 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.467739 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d899dc46d-wjcf9"] Sep 18 13:23:03.470598 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:23:03.470566 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podface2844_8901_42b7_a9e1_40854921ea56.slice/crio-4f17c460b64d046dfae37cc78cfd47217ffb0b3b7c43dfbd46eced012414780c WatchSource:0}: Error finding container 4f17c460b64d046dfae37cc78cfd47217ffb0b3b7c43dfbd46eced012414780c: Status 404 returned error can't find the container with id 4f17c460b64d046dfae37cc78cfd47217ffb0b3b7c43dfbd46eced012414780c Sep 18 13:23:03.918305 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.918267 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t88fv" Sep 18 13:23:03.963518 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:03.963476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"4f17c460b64d046dfae37cc78cfd47217ffb0b3b7c43dfbd46eced012414780c"} Sep 18 13:23:04.783139 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.783103 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4"] Sep 18 13:23:04.785684 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.785652 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.788883 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.788857 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 13:23:04.788883 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.788881 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 13:23:04.789043 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.788943 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 13:23:04.789043 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.789013 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hz5m6\"" Sep 18 13:23:04.789162 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.789046 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 13:23:04.790121 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.790095 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 13:23:04.794823 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.794804 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 13:23:04.807668 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.807615 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4"] Sep 18 13:23:04.874932 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.874898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25ll\" (UniqueName: \"kubernetes.io/projected/bc25fd1e-2580-431c-ac55-a0930e74d5ba-kube-api-access-k25ll\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875082 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.874958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-federate-client-tls\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875082 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.875018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-serving-certs-ca-bundle\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875082 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.875071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.875120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-telemeter-client-tls\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.875145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-secret-telemeter-client\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.875174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-metrics-client-ca\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.875219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.875197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.971345 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.971306 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d"} Sep 18 13:23:04.971784 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.971379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36"} Sep 18 13:23:04.971784 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.971415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c"} Sep 18 13:23:04.971784 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.971441 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4"} Sep 18 13:23:04.975777 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-telemeter-client-tls\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.975914 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-secret-telemeter-client\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.975914 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-metrics-client-ca\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.975914 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.976038 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25ll\" (UniqueName: \"kubernetes.io/projected/bc25fd1e-2580-431c-ac55-a0930e74d5ba-kube-api-access-k25ll\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.976038 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-federate-client-tls\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.976038 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.975998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-serving-certs-ca-bundle\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.976176 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.976039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.976731 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.976705 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-serving-certs-ca-bundle\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.976834 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.976705 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-metrics-client-ca\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.977393 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.977367 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc25fd1e-2580-431c-ac55-a0930e74d5ba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.978943 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.978922 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.979096 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.979077 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-telemeter-client-tls\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.979156 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.979095 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-federate-client-tls\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.979156 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.979104 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc25fd1e-2580-431c-ac55-a0930e74d5ba-secret-telemeter-client\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:04.986449 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:04.986430 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25ll\" (UniqueName: \"kubernetes.io/projected/bc25fd1e-2580-431c-ac55-a0930e74d5ba-kube-api-access-k25ll\") pod \"telemeter-client-6c98b7dcc7-gnpt4\" (UID: \"bc25fd1e-2580-431c-ac55-a0930e74d5ba\") " pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:05.097362 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.097341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" Sep 18 13:23:05.386210 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.385884 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4"] Sep 18 13:23:05.388317 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:23:05.388293 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc25fd1e_2580_431c_ac55_a0930e74d5ba.slice/crio-8b3b11c22b3962f57319a37f7154cc4c07586aaadc247222a9e9d3ed8439b3ae WatchSource:0}: Error finding container 8b3b11c22b3962f57319a37f7154cc4c07586aaadc247222a9e9d3ed8439b3ae: Status 404 returned error can't find the container with id 8b3b11c22b3962f57319a37f7154cc4c07586aaadc247222a9e9d3ed8439b3ae Sep 18 13:23:05.977076 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.977041 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" event={"ID":"bc25fd1e-2580-431c-ac55-a0930e74d5ba","Type":"ContainerStarted","Data":"8b3b11c22b3962f57319a37f7154cc4c07586aaadc247222a9e9d3ed8439b3ae"} Sep 18 13:23:05.980730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.980706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06"} Sep 18 13:23:05.980831 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.980769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerStarted","Data":"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0"} Sep 18 13:23:05.984459 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.984430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"d3ba4a56a107553437919415e47caf5e074a4a486fef38ffc7c62b0f38416ab2"} Sep 18 13:23:05.984563 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.984507 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"ff383d50a726c53e7bd56a8aad3733de71d94172b13517763bd51392cbe72c64"} Sep 18 13:23:05.984563 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.984553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"fc9d15626cda10cbd4a8c4bea75a0d107248e3de1d7713f22ffa03b582d99896"} Sep 18 13:23:05.984645 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.984593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"7de527e0e76353485e289dee8bc731ffcda4969684685d8d2d637dfd0e7413df"} Sep 18 13:23:05.984645 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:05.984635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"fdc3ba0a55edb5be227d667dfbd569f0d99035b6669cdece429d0103e6276c5c"} Sep 18 13:23:06.000886 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:06.000858 2563 patch_prober.go:28] interesting pod/image-registry-56885fd79-nv7sr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 13:23:06.000985 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:06.000907 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" podUID="e3f64119-7f94-4fe0-8418-029bbbddae5a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:23:06.038512 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:06.038443 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.996255818 podStartE2EDuration="6.038420842s" totalImagesPullingTime="3.026703844s" totalInitContainerRuntime="15.46118ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:06.037976564 +0000 UTC m=+114.945057226" watchObservedRunningTime="2026-09-18 13:23:06.038420842 +0000 UTC m=+114.945501506" Sep 18 13:23:06.992173 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:06.992135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" event={"ID":"face2844-8901-42b7-a9e1-40854921ea56","Type":"ContainerStarted","Data":"a38253fbd9e0f784f34ce86c3d662dd2b89902403fbf4e9077a214638b0620e4"} Sep 18 13:23:06.992778 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:06.992709 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:07.029602 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:07.029553 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" podStartSLOduration=2.851521081 podStartE2EDuration="5.029535887s" totalImagesPullingTime="2.178014806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:07.027950007 +0000 UTC m=+115.935030667" watchObservedRunningTime="2026-09-18 13:23:07.029535887 +0000 UTC m=+115.936616547" Sep 18 13:23:07.887455 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:07.887423 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56885fd79-nv7sr" Sep 18 13:23:07.998667 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:07.998629 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" event={"ID":"bc25fd1e-2580-431c-ac55-a0930e74d5ba","Type":"ContainerStarted","Data":"df5e859cbbae1bc2a7aa85ff288cf414c49a7d960ddba6132be1d18f0d62a1fe"} Sep 18 13:23:07.999054 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:07.998717 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" event={"ID":"bc25fd1e-2580-431c-ac55-a0930e74d5ba","Type":"ContainerStarted","Data":"c83d3c87c35c6ba0d642b9bf338f51c087a2159591a17e6a6bb80b222f3b6c1c"} Sep 18 13:23:07.999054 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:07.998742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" event={"ID":"bc25fd1e-2580-431c-ac55-a0930e74d5ba","Type":"ContainerStarted","Data":"7db395c3956fa108185fa84aaeb5ddedd7524f8428530d3b2fd5a96af16aad27"} Sep 18 13:23:08.034144 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:08.034095 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c98b7dcc7-gnpt4" podStartSLOduration=2.191202539 podStartE2EDuration="4.034080366s" totalImagesPullingTime="1.842877827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:08.032602046 +0000 UTC m=+116.939682707" watchObservedRunningTime="2026-09-18 13:23:08.034080366 +0000 UTC m=+116.941161027" Sep 18 13:23:12.372832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:12.372802 2563 scope.go:117] "RemoveContainer" containerID="da92f7e3f3465eb81fb1cff0f0547e8d37a2dcf121ef4875c5ac359ba326bf84" Sep 18 13:23:13.004135 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:13.004103 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d899dc46d-wjcf9" Sep 18 13:23:13.018940 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:13.018911 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:23:13.019106 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:13.019033 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" event={"ID":"04d37d2e-920f-438a-9164-83583ea3db84","Type":"ContainerStarted","Data":"4fee05082990432ba38fd7794859759ac72eeec9da3d3bfb4d33aa3820db52df"} Sep 18 13:23:13.019352 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:13.019333 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:23:13.023827 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:13.023808 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" Sep 18 13:23:13.064111 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:13.064056 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-56jh2" podStartSLOduration=54.728065993 podStartE2EDuration="58.0640376s" totalImagesPullingTime="3.335971607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:13.062913828 +0000 UTC m=+121.969994480" watchObservedRunningTime="2026-09-18 13:23:13.0640376 +0000 UTC m=+121.971118261" Sep 18 13:23:23.028484 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:23.028449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:23:23.030902 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:23.030879 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d91a8ab9-e813-4d4f-b76c-87c102b623bc-metrics-certs\") pod \"network-metrics-daemon-hptsl\" (UID: \"d91a8ab9-e813-4d4f-b76c-87c102b623bc\") " pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:23:23.189179 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:23.189148 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vpkk2\"" Sep 18 13:23:23.197113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:23.197097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hptsl" Sep 18 13:23:23.481016 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:23.480991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hptsl"] Sep 18 13:23:23.483039 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:23:23.483014 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91a8ab9_e813_4d4f_b76c_87c102b623bc.slice/crio-e70e9c454defbf914fd153dcc32a0f83f1f3a63f11d14880b412282027a53d42 WatchSource:0}: Error finding container e70e9c454defbf914fd153dcc32a0f83f1f3a63f11d14880b412282027a53d42: Status 404 returned error can't find the container with id e70e9c454defbf914fd153dcc32a0f83f1f3a63f11d14880b412282027a53d42 Sep 18 13:23:24.064557 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.064523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hptsl" event={"ID":"d91a8ab9-e813-4d4f-b76c-87c102b623bc","Type":"ContainerStarted","Data":"e70e9c454defbf914fd153dcc32a0f83f1f3a63f11d14880b412282027a53d42"} Sep 18 13:23:24.237493 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.237457 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c7b67c8d-t2cjk"] Sep 18 13:23:24.240164 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.240141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.243481 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.243458 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 13:23:24.244102 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.244081 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 13:23:24.244767 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.244743 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hzpsh\"" Sep 18 13:23:24.245069 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.245045 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 13:23:24.245587 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.245425 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 13:23:24.245587 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.245456 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 13:23:24.245587 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.245475 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 13:23:24.245587 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.245475 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 13:23:24.264685 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.264648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c7b67c8d-t2cjk"] Sep 18 13:23:24.340242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.340029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-service-ca\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.340242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.340109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-oauth-serving-cert\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.340242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.340142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-oauth-config\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.340242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.340191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-serving-cert\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.340242 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.340225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668pt\" (UniqueName: \"kubernetes.io/projected/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-kube-api-access-668pt\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.340557 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.340283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-config\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.441200 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.441169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-serving-cert\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.441338 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.441218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668pt\" (UniqueName: \"kubernetes.io/projected/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-kube-api-access-668pt\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.441338 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.441256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-config\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.441338 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.441287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-service-ca\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.441491 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.441358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-oauth-serving-cert\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.441491 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.441391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-oauth-config\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.442081 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.442003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-config\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.442845 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.442820 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-service-ca\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.442963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.442822 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-oauth-serving-cert\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.444060 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.444041 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-serving-cert\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.444256 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.444234 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-oauth-config\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.450594 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.450575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668pt\" (UniqueName: \"kubernetes.io/projected/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-kube-api-access-668pt\") pod \"console-84c7b67c8d-t2cjk\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.551870 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.551837 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:24.832068 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:24.832043 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c7b67c8d-t2cjk"] Sep 18 13:23:24.833803 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:23:24.833777 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8a5746_f86c_44c4_9a5e_cc569bb4f9f3.slice/crio-b9ff7acfa82640a1ebf33e8a9ce4114f2fcf7dd58dce4498c086e77a6fc061ba WatchSource:0}: Error finding container b9ff7acfa82640a1ebf33e8a9ce4114f2fcf7dd58dce4498c086e77a6fc061ba: Status 404 returned error can't find the container with id b9ff7acfa82640a1ebf33e8a9ce4114f2fcf7dd58dce4498c086e77a6fc061ba Sep 18 13:23:25.070140 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:25.070101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hptsl" event={"ID":"d91a8ab9-e813-4d4f-b76c-87c102b623bc","Type":"ContainerStarted","Data":"b17b615cb44463e6c34ec8977e0e6c647d5a4ecdbf75914c8801d1aff64aba57"} Sep 18 13:23:25.070577 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:25.070156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hptsl" event={"ID":"d91a8ab9-e813-4d4f-b76c-87c102b623bc","Type":"ContainerStarted","Data":"93f6e403c5a744b546c91e61475535e11e9b059a07dfd430ee8749b0d94dc28e"} Sep 18 13:23:25.071391 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:25.071369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7b67c8d-t2cjk" event={"ID":"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3","Type":"ContainerStarted","Data":"b9ff7acfa82640a1ebf33e8a9ce4114f2fcf7dd58dce4498c086e77a6fc061ba"} Sep 18 13:23:25.108557 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:25.108507 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hptsl" podStartSLOduration=131.281357019 podStartE2EDuration="2m12.108490372s" totalImagesPullingTime="827.133353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:25.107660529 +0000 UTC m=+134.014741190" watchObservedRunningTime="2026-09-18 13:23:25.108490372 +0000 UTC m=+134.015571085" Sep 18 13:23:26.078976 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:26.078763 2563 generic.go:356] "Generic (PLEG): container finished" podID="851f068d-7236-45c4-a155-7a16c9f0f47b" containerID="8c7de86a992daa360655e5139e6b407c5477f335462564ae57fc4468c8ab3a4c" exitCode=0 Sep 18 13:23:26.078976 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:26.078838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" event={"ID":"851f068d-7236-45c4-a155-7a16c9f0f47b","Type":"ContainerDied","Data":"8c7de86a992daa360655e5139e6b407c5477f335462564ae57fc4468c8ab3a4c"} Sep 18 13:23:26.079494 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:26.079339 2563 scope.go:117] "RemoveContainer" containerID="8c7de86a992daa360655e5139e6b407c5477f335462564ae57fc4468c8ab3a4c" Sep 18 13:23:27.086159 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:27.086126 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jrpwd" event={"ID":"851f068d-7236-45c4-a155-7a16c9f0f47b","Type":"ContainerStarted","Data":"a83d49014f15e022edbe0cdfdb221b4fdc328ad5c5487d5af3acffcc58008c7b"} Sep 18 13:23:29.097710 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:29.097604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7b67c8d-t2cjk" event={"ID":"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3","Type":"ContainerStarted","Data":"db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1"} Sep 18 13:23:29.122411 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:29.122361 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c7b67c8d-t2cjk" podStartSLOduration=1.111692915 podStartE2EDuration="5.122346498s" totalImagesPullingTime="4.010653583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:29.120105492 +0000 UTC m=+138.027186154" watchObservedRunningTime="2026-09-18 13:23:29.122346498 +0000 UTC m=+138.029427159" Sep 18 13:23:34.552157 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:34.552124 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:34.552530 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:34.552169 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:34.556910 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:34.556889 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:35.124314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:35.124280 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:23:36.126656 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:36.126623 2563 generic.go:356] "Generic (PLEG): container finished" podID="20fb5c48-58fd-48b3-ac86-0c46e8432bc4" containerID="56872e8d2f207f487daa7cb9c917c1f71004c81ed0753e49353f904c6c323002" exitCode=0 Sep 18 13:23:36.127059 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:36.126706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" event={"ID":"20fb5c48-58fd-48b3-ac86-0c46e8432bc4","Type":"ContainerDied","Data":"56872e8d2f207f487daa7cb9c917c1f71004c81ed0753e49353f904c6c323002"} Sep 18 13:23:36.127159 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:36.127144 2563 scope.go:117] "RemoveContainer" containerID="56872e8d2f207f487daa7cb9c917c1f71004c81ed0753e49353f904c6c323002" Sep 18 13:23:37.132982 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:37.132946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-5d2bt" event={"ID":"20fb5c48-58fd-48b3-ac86-0c46e8432bc4","Type":"ContainerStarted","Data":"5437a88e72871a35c9c99bbba432995eb64b15bd678f012529cdda17bd9d1f2c"} Sep 18 13:23:45.167291 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:23:45.167252 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c7b67c8d-t2cjk"] Sep 18 13:24:10.191647 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.191601 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84c7b67c8d-t2cjk" podUID="cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" containerName="console" containerID="cri-o://db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1" gracePeriod=15 Sep 18 13:24:10.434330 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.434306 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:24:10.532860 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.532790 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-oauth-serving-cert\") pod \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " Sep 18 13:24:10.532860 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.532830 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-668pt\" (UniqueName: \"kubernetes.io/projected/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-kube-api-access-668pt\") pod \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " Sep 18 13:24:10.532860 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.532852 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-config\") pod \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " Sep 18 13:24:10.533103 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533028 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-oauth-config\") pod \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " Sep 18 13:24:10.533167 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533114 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-service-ca\") pod \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " Sep 18 13:24:10.533495 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533232 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-config" (OuterVolumeSpecName: "console-config") pod "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" (UID: "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:24:10.533495 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533236 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" (UID: "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:24:10.533495 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533148 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-serving-cert\") pod \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\" (UID: \"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3\") " Sep 18 13:24:10.533702 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533494 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" (UID: "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:24:10.533702 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533614 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:10.533702 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533634 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:10.533702 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.533646 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-oauth-serving-cert\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:10.535198 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.535175 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-kube-api-access-668pt" (OuterVolumeSpecName: "kube-api-access-668pt") pod "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" (UID: "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3"). InnerVolumeSpecName "kube-api-access-668pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:24:10.535273 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.535241 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" (UID: "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:10.535273 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.535267 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" (UID: "cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:10.634909 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.634884 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-668pt\" (UniqueName: \"kubernetes.io/projected/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-kube-api-access-668pt\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:10.634909 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.634909 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-oauth-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:10.635095 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:10.634922 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3-console-serving-cert\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:11.262654 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.262622 2563 generic.go:356] "Generic (PLEG): container finished" podID="cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" containerID="db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1" exitCode=0 Sep 18 13:24:11.263113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.262671 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7b67c8d-t2cjk" Sep 18 13:24:11.263113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.262705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7b67c8d-t2cjk" event={"ID":"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3","Type":"ContainerDied","Data":"db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1"} Sep 18 13:24:11.263113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.262785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7b67c8d-t2cjk" event={"ID":"cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3","Type":"ContainerDied","Data":"b9ff7acfa82640a1ebf33e8a9ce4114f2fcf7dd58dce4498c086e77a6fc061ba"} Sep 18 13:24:11.263113 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.262808 2563 scope.go:117] "RemoveContainer" containerID="db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1" Sep 18 13:24:11.271434 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.271415 2563 scope.go:117] "RemoveContainer" containerID="db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1" Sep 18 13:24:11.271688 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:11.271654 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1\": container with ID starting with db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1 not found: ID does not exist" containerID="db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1" Sep 18 13:24:11.271740 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.271700 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1"} err="failed to get container status \"db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1\": rpc error: code = NotFound desc = could not find container \"db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1\": container with ID starting with db305c570f8ca2c6e387b93768957afc8a58c0e89fc566491b73bd495519a3b1 not found: ID does not exist" Sep 18 13:24:11.286717 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.286694 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c7b67c8d-t2cjk"] Sep 18 13:24:11.293715 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.293696 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c7b67c8d-t2cjk"] Sep 18 13:24:11.377837 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:11.377803 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" path="/var/lib/kubelet/pods/cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3/volumes" Sep 18 13:24:20.351351 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351316 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:24:20.351777 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351579 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="alertmanager" containerID="cri-o://aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4" gracePeriod=120 Sep 18 13:24:20.351777 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351645 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-metric" containerID="cri-o://70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0" gracePeriod=120 Sep 18 13:24:20.351777 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351714 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-web" containerID="cri-o://dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36" gracePeriod=120 Sep 18 13:24:20.351777 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351743 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="config-reloader" containerID="cri-o://fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c" gracePeriod=120 Sep 18 13:24:20.351991 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351770 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="prom-label-proxy" containerID="cri-o://fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06" gracePeriod=120 Sep 18 13:24:20.351991 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:20.351805 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy" containerID="cri-o://ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d" gracePeriod=120 Sep 18 13:24:21.311265 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311229 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06" exitCode=0 Sep 18 13:24:21.311265 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311256 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d" exitCode=0 Sep 18 13:24:21.311265 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311265 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c" exitCode=0 Sep 18 13:24:21.311265 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311272 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4" exitCode=0 Sep 18 13:24:21.311530 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06"} Sep 18 13:24:21.311530 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d"} Sep 18 13:24:21.311530 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c"} Sep 18 13:24:21.311530 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.311428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4"} Sep 18 13:24:21.606559 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.606532 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:21.732913 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.732877 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-web\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733099 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.732966 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733099 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.732996 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-cluster-tls-config\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733099 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733029 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-web-config\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733099 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733067 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-trusted-ca-bundle\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733308 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733104 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733308 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733149 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-metrics-client-ca\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733308 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733183 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb7gf\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-kube-api-access-sb7gf\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733308 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733208 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-main-db\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733308 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733252 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-volume\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733308 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733280 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-main-tls\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733327 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-tls-assets\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733352 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-out\") pod \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\" (UID: \"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9\") " Sep 18 13:24:21.733993 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.733959 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:24:21.734874 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.734780 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:24:21.734988 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.734936 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:24:21.736382 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.736349 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-kube-api-access-sb7gf" (OuterVolumeSpecName: "kube-api-access-sb7gf") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "kube-api-access-sb7gf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:24:21.736670 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.736639 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.736793 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.736746 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-out" (OuterVolumeSpecName: "config-out") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:24:21.736873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.736848 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-volume" (OuterVolumeSpecName: "config-volume") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.737904 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.737866 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.738009 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.737975 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.738129 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.738106 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.738357 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.738335 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:24:21.740945 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.740922 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.747581 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.747555 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-web-config" (OuterVolumeSpecName: "web-config") pod "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" (UID: "6cb2f46a-5883-4b76-a08f-0c32e2ef03c9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:24:21.834219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834168 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-tls-assets\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834211 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-out\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834222 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834232 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834219 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834242 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-cluster-tls-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834253 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-web-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834262 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834270 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834279 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-metrics-client-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834287 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb7gf\" (UniqueName: \"kubernetes.io/projected/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-kube-api-access-sb7gf\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834294 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-alertmanager-main-db\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834302 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-config-volume\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:21.834535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:21.834310 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9-secret-alertmanager-main-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:24:22.318436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318401 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0" exitCode=0 Sep 18 13:24:22.318436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318427 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerID="dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36" exitCode=0 Sep 18 13:24:22.318714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0"} Sep 18 13:24:22.318714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318495 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.318714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36"} Sep 18 13:24:22.318714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6cb2f46a-5883-4b76-a08f-0c32e2ef03c9","Type":"ContainerDied","Data":"a3784d070b0cd060d06b00c90b3f146520e0171fc2ae02bb861df132d6931ac7"} Sep 18 13:24:22.318714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.318668 2563 scope.go:117] "RemoveContainer" containerID="fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06" Sep 18 13:24:22.326649 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.326618 2563 scope.go:117] "RemoveContainer" containerID="70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0" Sep 18 13:24:22.333714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.333665 2563 scope.go:117] "RemoveContainer" containerID="ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d" Sep 18 13:24:22.340535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.340510 2563 scope.go:117] "RemoveContainer" containerID="dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36" Sep 18 13:24:22.346091 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.346069 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:24:22.347685 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.347654 2563 scope.go:117] "RemoveContainer" containerID="fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c" Sep 18 13:24:22.350396 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.350375 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:24:22.354662 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.354645 2563 scope.go:117] "RemoveContainer" containerID="aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4" Sep 18 13:24:22.361483 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.361465 2563 scope.go:117] "RemoveContainer" containerID="d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4" Sep 18 13:24:22.368144 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.368128 2563 scope.go:117] "RemoveContainer" containerID="fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06" Sep 18 13:24:22.368406 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.368389 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06\": container with ID starting with fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06 not found: ID does not exist" containerID="fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06" Sep 18 13:24:22.368450 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.368414 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06"} err="failed to get container status \"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06\": rpc error: code = NotFound desc = could not find container \"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06\": container with ID starting with fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06 not found: ID does not exist" Sep 18 13:24:22.368450 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.368433 2563 scope.go:117] "RemoveContainer" containerID="70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0" Sep 18 13:24:22.368709 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.368690 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0\": container with ID starting with 70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0 not found: ID does not exist" containerID="70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0" Sep 18 13:24:22.368778 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.368719 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0"} err="failed to get container status \"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0\": rpc error: code = NotFound desc = could not find container \"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0\": container with ID starting with 70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0 not found: ID does not exist" Sep 18 13:24:22.368778 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.368743 2563 scope.go:117] "RemoveContainer" containerID="ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d" Sep 18 13:24:22.369005 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.368988 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d\": container with ID starting with ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d not found: ID does not exist" containerID="ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d" Sep 18 13:24:22.369039 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369013 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d"} err="failed to get container status \"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d\": rpc error: code = NotFound desc = could not find container \"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d\": container with ID starting with ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d not found: ID does not exist" Sep 18 13:24:22.369039 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369030 2563 scope.go:117] "RemoveContainer" containerID="dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36" Sep 18 13:24:22.369259 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.369242 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36\": container with ID starting with dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36 not found: ID does not exist" containerID="dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36" Sep 18 13:24:22.369301 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369264 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36"} err="failed to get container status \"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36\": rpc error: code = NotFound desc = could not find container \"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36\": container with ID starting with dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36 not found: ID does not exist" Sep 18 13:24:22.369301 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369279 2563 scope.go:117] "RemoveContainer" containerID="fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c" Sep 18 13:24:22.369485 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.369469 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c\": container with ID starting with fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c not found: ID does not exist" containerID="fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c" Sep 18 13:24:22.369539 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369498 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c"} err="failed to get container status \"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c\": rpc error: code = NotFound desc = could not find container \"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c\": container with ID starting with fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c not found: ID does not exist" Sep 18 13:24:22.369539 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369518 2563 scope.go:117] "RemoveContainer" containerID="aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4" Sep 18 13:24:22.369745 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.369730 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4\": container with ID starting with aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4 not found: ID does not exist" containerID="aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4" Sep 18 13:24:22.369782 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369748 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4"} err="failed to get container status \"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4\": rpc error: code = NotFound desc = could not find container \"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4\": container with ID starting with aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4 not found: ID does not exist" Sep 18 13:24:22.369782 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369762 2563 scope.go:117] "RemoveContainer" containerID="d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4" Sep 18 13:24:22.369987 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:24:22.369974 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4\": container with ID starting with d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4 not found: ID does not exist" containerID="d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4" Sep 18 13:24:22.370024 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.369991 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4"} err="failed to get container status \"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4\": rpc error: code = NotFound desc = could not find container \"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4\": container with ID starting with d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4 not found: ID does not exist" Sep 18 13:24:22.370024 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370005 2563 scope.go:117] "RemoveContainer" containerID="fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06" Sep 18 13:24:22.370207 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370194 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06"} err="failed to get container status \"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06\": rpc error: code = NotFound desc = could not find container \"fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06\": container with ID starting with fbe1630e066ac4015d283c99b1b0f6582a65c4645e0fa1e23a3fc12bfcfebf06 not found: ID does not exist" Sep 18 13:24:22.370244 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370209 2563 scope.go:117] "RemoveContainer" containerID="70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0" Sep 18 13:24:22.370414 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370398 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0"} err="failed to get container status \"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0\": rpc error: code = NotFound desc = could not find container \"70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0\": container with ID starting with 70ea23a11878b8da25249ebb317010b9f9ed03278c8dfa4b1fd77fb2a1df39f0 not found: ID does not exist" Sep 18 13:24:22.370455 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370415 2563 scope.go:117] "RemoveContainer" containerID="ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d" Sep 18 13:24:22.370629 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370611 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d"} err="failed to get container status \"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d\": rpc error: code = NotFound desc = could not find container \"ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d\": container with ID starting with ce25bd8976b24962ccfa51e01cf1f56485ff1f827169039cfa5563068fe3392d not found: ID does not exist" Sep 18 13:24:22.370666 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370631 2563 scope.go:117] "RemoveContainer" containerID="dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36" Sep 18 13:24:22.370853 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370838 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36"} err="failed to get container status \"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36\": rpc error: code = NotFound desc = could not find container \"dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36\": container with ID starting with dc793a6efc67486827c945d9f8e237c88fe8ecf9dafc5e6b23b3e26b35a2cf36 not found: ID does not exist" Sep 18 13:24:22.370896 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.370855 2563 scope.go:117] "RemoveContainer" containerID="fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c" Sep 18 13:24:22.371053 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.371034 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c"} err="failed to get container status \"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c\": rpc error: code = NotFound desc = could not find container \"fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c\": container with ID starting with fe89b1e1ab3ee3cab265187ea35a65fe11f787061d0aa833f2ecfb57e93d050c not found: ID does not exist" Sep 18 13:24:22.371135 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.371055 2563 scope.go:117] "RemoveContainer" containerID="aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4" Sep 18 13:24:22.371313 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.371295 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4"} err="failed to get container status \"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4\": rpc error: code = NotFound desc = could not find container \"aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4\": container with ID starting with aed3e5938420a56ce32eaca272ee1e59b81a5da46cf468106e82431d048e79e4 not found: ID does not exist" Sep 18 13:24:22.371361 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.371314 2563 scope.go:117] "RemoveContainer" containerID="d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4" Sep 18 13:24:22.371560 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.371540 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4"} err="failed to get container status \"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4\": rpc error: code = NotFound desc = could not find container \"d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4\": container with ID starting with d93688d44db066fec83163a6da3cf5601a9307f11eaba1d7e5d923676c8f4cb4 not found: ID does not exist" Sep 18 13:24:22.384215 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384194 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:24:22.384455 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384444 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384458 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384473 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-web" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384478 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-web" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384487 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="config-reloader" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384493 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="config-reloader" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384501 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" containerName="console" Sep 18 13:24:22.384508 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384507 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" containerName="console" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384513 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="alertmanager" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384519 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="alertmanager" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384531 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="init-config-reloader" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384536 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="init-config-reloader" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384541 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-metric" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384546 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-metric" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384551 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="prom-label-proxy" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384556 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="prom-label-proxy" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384595 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="alertmanager" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384606 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="config-reloader" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384612 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8a5746-f86c-44c4-9a5e-cc569bb4f9f3" containerName="console" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384618 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-web" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384624 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy-metric" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384630 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="prom-label-proxy" Sep 18 13:24:22.384725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.384635 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" containerName="kube-rbac-proxy" Sep 18 13:24:22.389602 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.389584 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.392449 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.392433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 13:24:22.392879 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.392859 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 13:24:22.392996 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.392863 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 13:24:22.392996 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.392887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 13:24:22.392996 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.392898 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 13:24:22.392996 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.392977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xv8lb\"" Sep 18 13:24:22.393251 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.393233 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 13:24:22.393512 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.393496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 13:24:22.393629 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.393606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 13:24:22.398486 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.398468 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 13:24:22.404660 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.404641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:24:22.553965 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.553935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cc99501-c4e1-46b8-b39c-1332310aebdf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.553985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cc99501-c4e1-46b8-b39c-1332310aebdf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cc99501-c4e1-46b8-b39c-1332310aebdf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cc99501-c4e1-46b8-b39c-1332310aebdf-config-out\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554184 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554451 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-web-config\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554451 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhwbd\" (UniqueName: \"kubernetes.io/projected/7cc99501-c4e1-46b8-b39c-1332310aebdf-kube-api-access-zhwbd\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554451 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cc99501-c4e1-46b8-b39c-1332310aebdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.554451 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.554252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655205 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-web-config\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhwbd\" (UniqueName: \"kubernetes.io/projected/7cc99501-c4e1-46b8-b39c-1332310aebdf-kube-api-access-zhwbd\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cc99501-c4e1-46b8-b39c-1332310aebdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cc99501-c4e1-46b8-b39c-1332310aebdf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cc99501-c4e1-46b8-b39c-1332310aebdf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cc99501-c4e1-46b8-b39c-1332310aebdf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.655671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.656229 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.655886 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cc99501-c4e1-46b8-b39c-1332310aebdf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.656289 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.656275 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cc99501-c4e1-46b8-b39c-1332310aebdf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.656342 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.656323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.656394 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.656367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cc99501-c4e1-46b8-b39c-1332310aebdf-config-out\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.656755 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.656534 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cc99501-c4e1-46b8-b39c-1332310aebdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.658605 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.658582 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.658737 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.658623 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-web-config\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.658816 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.658789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.659127 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.659106 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.659127 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.659130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cc99501-c4e1-46b8-b39c-1332310aebdf-config-out\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.659423 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.659188 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cc99501-c4e1-46b8-b39c-1332310aebdf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.659423 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.659409 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.659535 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.659476 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.660714 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.660669 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cc99501-c4e1-46b8-b39c-1332310aebdf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.664972 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.664952 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhwbd\" (UniqueName: \"kubernetes.io/projected/7cc99501-c4e1-46b8-b39c-1332310aebdf-kube-api-access-zhwbd\") pod \"alertmanager-main-0\" (UID: \"7cc99501-c4e1-46b8-b39c-1332310aebdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.700157 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.700124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:24:22.986095 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:22.986067 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:24:22.986625 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:24:22.986603 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc99501_c4e1_46b8_b39c_1332310aebdf.slice/crio-b456f63bdd27c024133ea3e496e975d549f8708f3d5f459f729f7d1e6ff601bd WatchSource:0}: Error finding container b456f63bdd27c024133ea3e496e975d549f8708f3d5f459f729f7d1e6ff601bd: Status 404 returned error can't find the container with id b456f63bdd27c024133ea3e496e975d549f8708f3d5f459f729f7d1e6ff601bd Sep 18 13:24:23.324154 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:23.324067 2563 generic.go:356] "Generic (PLEG): container finished" podID="7cc99501-c4e1-46b8-b39c-1332310aebdf" containerID="cce95b4c226156dd61e7d0993c480f81fd10b935c453824c352bd9dfca7d1908" exitCode=0 Sep 18 13:24:23.324314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:23.324158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerDied","Data":"cce95b4c226156dd61e7d0993c480f81fd10b935c453824c352bd9dfca7d1908"} Sep 18 13:24:23.324314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:23.324222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"b456f63bdd27c024133ea3e496e975d549f8708f3d5f459f729f7d1e6ff601bd"} Sep 18 13:24:23.382406 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:23.382374 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb2f46a-5883-4b76-a08f-0c32e2ef03c9" path="/var/lib/kubelet/pods/6cb2f46a-5883-4b76-a08f-0c32e2ef03c9/volumes" Sep 18 13:24:24.333288 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.333257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"02faaa7aab3ed2167935ec5a7bfa3ab6505e8de9c016704f224c7eab5456518f"} Sep 18 13:24:24.333671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.333321 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"1347c9ae508c92dab9a8d4db63ccebdab59f229e4c4bae9470e1d9a8e9c6a52d"} Sep 18 13:24:24.333671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.333348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"7c6ce13407dbe462f3e5bdedcdb2392e4385438384344b2d7842601947c9eb0c"} Sep 18 13:24:24.333671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.333373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"8c9331ec6708eb6206c50dba78279b331aec0a4e9123e1ffae4996f1dd3e28f7"} Sep 18 13:24:24.333671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.333409 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"a2953ae021e7312f3fa05f68ec11fbd317b326a5ebdbebb4d3e54915a242874a"} Sep 18 13:24:24.333671 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.333436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cc99501-c4e1-46b8-b39c-1332310aebdf","Type":"ContainerStarted","Data":"bb039c7141da25eb5a9e4a43d526bb079cb25dfac8c547af90159dfe2a2cdf63"} Sep 18 13:24:24.390389 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:24:24.390332 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.374893376 podStartE2EDuration="2.390315298s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.421922ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:24.384198291 +0000 UTC m=+193.291278951" watchObservedRunningTime="2026-09-18 13:24:24.390315298 +0000 UTC m=+193.297395969" Sep 18 13:25:43.889721 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.889622 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp"] Sep 18 13:25:43.892854 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.892839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.895894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.895876 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dx998\"" Sep 18 13:25:43.896024 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.896009 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 18 13:25:43.896233 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.896215 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 13:25:43.896450 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.896419 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 13:25:43.896519 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.896425 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 18 13:25:43.896573 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.896430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 18 13:25:43.897116 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.897101 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 13:25:43.908916 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.908889 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d3d541-b0ab-494f-9311-97acf5235957-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909001 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.908935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909080 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.908998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909080 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.909033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ggmt\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-kube-api-access-6ggmt\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909080 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.909066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909186 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.909100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909186 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.909123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:43.909865 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:43.909846 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp"] Sep 18 13:25:44.009884 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.009852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.009893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.009912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.009960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d3d541-b0ab-494f-9311-97acf5235957-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.009986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.010017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.010052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ggmt\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-kube-api-access-6ggmt\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.010599 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.010571 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.012383 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.012360 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.012529 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.012508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.012795 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.012775 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d3d541-b0ab-494f-9311-97acf5235957-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.012842 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.012783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.018140 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.018121 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ggmt\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-kube-api-access-6ggmt\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.018388 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.018368 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4hnxp\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.203382 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.203284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:44.479362 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.479337 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp"] Sep 18 13:25:44.481863 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:25:44.481834 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d3d541_b0ab_494f_9311_97acf5235957.slice/crio-9a910f30ba6f294b2920ba2afed5183ef0eb4b809f070d1b04e2a8ffdbac3453 WatchSource:0}: Error finding container 9a910f30ba6f294b2920ba2afed5183ef0eb4b809f070d1b04e2a8ffdbac3453: Status 404 returned error can't find the container with id 9a910f30ba6f294b2920ba2afed5183ef0eb4b809f070d1b04e2a8ffdbac3453 Sep 18 13:25:44.630550 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:44.630519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" event={"ID":"98d3d541-b0ab-494f-9311-97acf5235957","Type":"ContainerStarted","Data":"9a910f30ba6f294b2920ba2afed5183ef0eb4b809f070d1b04e2a8ffdbac3453"} Sep 18 13:25:47.232382 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:47.232336 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 18 13:25:47.232620 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:47.232429 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 18 13:25:47.645759 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:47.645725 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" event={"ID":"98d3d541-b0ab-494f-9311-97acf5235957","Type":"ContainerStarted","Data":"87da72e55e63a04a1ba06a11de25ea8d8ed8d0627d0c1e352e730191f10e2bfc"} Sep 18 13:25:47.645924 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:47.645848 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:25:47.675871 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:47.675821 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" podStartSLOduration=1.927928674 podStartE2EDuration="4.675805583s" totalImagesPullingTime="2.747876909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:25:47.675538577 +0000 UTC m=+276.582619237" watchObservedRunningTime="2026-09-18 13:25:47.675805583 +0000 UTC m=+276.582886243" Sep 18 13:25:48.653076 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:25:48.653046 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:26:07.323668 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.323631 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh"] Sep 18 13:26:07.327143 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.327121 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.331009 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.330980 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" podUID="db847fb3-90db-4bd5-8895-95308f36e80a" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.351857 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.351831 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 18 13:26:07.352111 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.352087 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-metrics-tls\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" type="*v1.Secret" Sep 18 13:26:07.352294 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.352278 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 18 13:26:07.352583 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.352566 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret" Sep 18 13:26:07.352634 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.352578 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" Sep 18 13:26:07.353316 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:07.353288 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-t24gz\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub-operator-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-t24gz\"" type="*v1.Secret" Sep 18 13:26:07.392328 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.392290 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh"] Sep 18 13:26:07.395140 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.395106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-webhook-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.395271 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.395145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68bp7\" (UniqueName: \"kubernetes.io/projected/db847fb3-90db-4bd5-8895-95308f36e80a-kube-api-access-68bp7\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.395271 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.395168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.395271 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.395253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-metrics-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.395450 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.395299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db847fb3-90db-4bd5-8895-95308f36e80a-tmp\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.395450 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.395327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db847fb3-90db-4bd5-8895-95308f36e80a-manifests\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.496747 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.496700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.496902 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.496766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-metrics-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.496902 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.496810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db847fb3-90db-4bd5-8895-95308f36e80a-tmp\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.496902 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.496834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db847fb3-90db-4bd5-8895-95308f36e80a-manifests\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.496902 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.496872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-webhook-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.496902 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.496894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68bp7\" (UniqueName: \"kubernetes.io/projected/db847fb3-90db-4bd5-8895-95308f36e80a-kube-api-access-68bp7\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.497254 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.497234 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db847fb3-90db-4bd5-8895-95308f36e80a-manifests\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:07.499182 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:07.499152 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db847fb3-90db-4bd5-8895-95308f36e80a-tmp\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:08.162793 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.162763 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 13:26:08.212606 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.212583 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 18 13:26:08.224716 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.224692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68bp7\" (UniqueName: \"kubernetes.io/projected/db847fb3-90db-4bd5-8895-95308f36e80a-kube-api-access-68bp7\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:08.231454 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.231434 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 13:26:08.239720 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.239698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:08.239868 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.239851 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-webhook-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:08.429038 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.428954 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 13:26:08.497787 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:08.497752 2563 secret.go:189] Couldn't get secret opendatahub-operator-system/opendatahub-operator-metrics-tls: failed to sync secret cache: timed out waiting for the condition Sep 18 13:26:08.497969 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:08.497844 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-metrics-cert podName:db847fb3-90db-4bd5-8895-95308f36e80a nodeName:}" failed. No retries permitted until 2026-09-18 13:26:08.997827217 +0000 UTC m=+297.904907861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-cert" (UniqueName: "kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-metrics-cert") pod "opendatahub-operator-controller-manager-67d4494bfd-9hsqh" (UID: "db847fb3-90db-4bd5-8895-95308f36e80a") : failed to sync secret cache: timed out waiting for the condition Sep 18 13:26:08.679167 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.679081 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-t24gz\"" Sep 18 13:26:08.901699 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:08.901644 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 18 13:26:09.008500 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:09.008413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-metrics-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:09.011262 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:09.011238 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db847fb3-90db-4bd5-8895-95308f36e80a-metrics-cert\") pod \"opendatahub-operator-controller-manager-67d4494bfd-9hsqh\" (UID: \"db847fb3-90db-4bd5-8895-95308f36e80a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:09.137503 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:09.137460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:09.434039 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:09.434009 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh"] Sep 18 13:26:09.435452 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:26:09.435425 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb847fb3_90db_4bd5_8895_95308f36e80a.slice/crio-0b2b37849d9113e1a019a24a934d1d5517bf1d4763ae8f141a8c2a3b527dd6bc WatchSource:0}: Error finding container 0b2b37849d9113e1a019a24a934d1d5517bf1d4763ae8f141a8c2a3b527dd6bc: Status 404 returned error can't find the container with id 0b2b37849d9113e1a019a24a934d1d5517bf1d4763ae8f141a8c2a3b527dd6bc Sep 18 13:26:09.732460 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:09.732369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" event={"ID":"db847fb3-90db-4bd5-8895-95308f36e80a","Type":"ContainerStarted","Data":"0b2b37849d9113e1a019a24a934d1d5517bf1d4763ae8f141a8c2a3b527dd6bc"} Sep 18 13:26:12.747196 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:12.747166 2563 generic.go:356] "Generic (PLEG): container finished" podID="db847fb3-90db-4bd5-8895-95308f36e80a" containerID="0b5c2e4e31679f1e5cdfe190aa20a6dfeb32cda09894759d551f3c96d7c36cd1" exitCode=0 Sep 18 13:26:12.747529 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:12.747229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" event={"ID":"db847fb3-90db-4bd5-8895-95308f36e80a","Type":"ContainerDied","Data":"0b5c2e4e31679f1e5cdfe190aa20a6dfeb32cda09894759d551f3c96d7c36cd1"} Sep 18 13:26:13.244822 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:13.244792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:26:13.252168 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:13.252141 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:26:13.256613 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:13.256590 2563 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 13:26:13.753564 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:13.753530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" event={"ID":"db847fb3-90db-4bd5-8895-95308f36e80a","Type":"ContainerStarted","Data":"e69b70947591a8a374e8dffacb00e5554c37d7e628b937da1adb88eb15921fdc"} Sep 18 13:26:13.755791 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:13.753632 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:13.781169 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:13.781125 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" podStartSLOduration=3.2080697750000002 podStartE2EDuration="6.781111894s" totalImagesPullingTime="3.087832425s" totalInitContainerRuntime="485.209694ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:26:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:26:13.779389439 +0000 UTC m=+302.686470101" watchObservedRunningTime="2026-09-18 13:26:13.781111894 +0000 UTC m=+302.688192576" Sep 18 13:26:24.760350 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:24.760317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-67d4494bfd-9hsqh" Sep 18 13:26:41.617500 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.617470 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq"] Sep 18 13:26:41.625141 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.625105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.639423 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.639399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8trht\"" Sep 18 13:26:41.643737 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.643720 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 13:26:41.644103 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.644089 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 13:26:41.664965 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.664945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq"] Sep 18 13:26:41.678832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.678806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4f9513-0941-4366-bf0e-67bfb576bec1-tmp\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.678931 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.678877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd264\" (UniqueName: \"kubernetes.io/projected/0e4f9513-0941-4366-bf0e-67bfb576bec1-kube-api-access-qd264\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.678931 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.678917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4f9513-0941-4366-bf0e-67bfb576bec1-tls-certs\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.779778 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.779742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd264\" (UniqueName: \"kubernetes.io/projected/0e4f9513-0941-4366-bf0e-67bfb576bec1-kube-api-access-qd264\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.779778 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.779783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4f9513-0941-4366-bf0e-67bfb576bec1-tls-certs\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.779999 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.779825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4f9513-0941-4366-bf0e-67bfb576bec1-tmp\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.779999 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:41.779916 2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 18 13:26:41.780104 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:26:41.780002 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4f9513-0941-4366-bf0e-67bfb576bec1-tls-certs podName:0e4f9513-0941-4366-bf0e-67bfb576bec1 nodeName:}" failed. No retries permitted until 2026-09-18 13:26:42.279986414 +0000 UTC m=+331.187067053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0e4f9513-0941-4366-bf0e-67bfb576bec1-tls-certs") pod "kube-auth-proxy-6c8bb48f8c-bs2kq" (UID: "0e4f9513-0941-4366-bf0e-67bfb576bec1") : secret "kube-auth-proxy-tls" not found Sep 18 13:26:41.782138 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.782117 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4f9513-0941-4366-bf0e-67bfb576bec1-tmp\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:41.802282 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:41.802251 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd264\" (UniqueName: \"kubernetes.io/projected/0e4f9513-0941-4366-bf0e-67bfb576bec1-kube-api-access-qd264\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:42.283367 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:42.283327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4f9513-0941-4366-bf0e-67bfb576bec1-tls-certs\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:42.285910 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:42.285887 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4f9513-0941-4366-bf0e-67bfb576bec1-tls-certs\") pod \"kube-auth-proxy-6c8bb48f8c-bs2kq\" (UID: \"0e4f9513-0941-4366-bf0e-67bfb576bec1\") " pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:42.535431 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:42.535336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" Sep 18 13:26:42.816479 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:42.816452 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq"] Sep 18 13:26:42.818277 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:26:42.818246 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4f9513_0941_4366_bf0e_67bfb576bec1.slice/crio-779d845817588219700a6e3a400dfb762e27b50cb58e46b25180addb77381924 WatchSource:0}: Error finding container 779d845817588219700a6e3a400dfb762e27b50cb58e46b25180addb77381924: Status 404 returned error can't find the container with id 779d845817588219700a6e3a400dfb762e27b50cb58e46b25180addb77381924 Sep 18 13:26:42.820158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:42.820132 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:26:42.870351 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:42.870312 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" event={"ID":"0e4f9513-0941-4366-bf0e-67bfb576bec1","Type":"ContainerStarted","Data":"779d845817588219700a6e3a400dfb762e27b50cb58e46b25180addb77381924"} Sep 18 13:26:44.880875 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:44.880845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" event={"ID":"0e4f9513-0941-4366-bf0e-67bfb576bec1","Type":"ContainerStarted","Data":"01b1cfd16d4f59db2cc2538c1c9388966652ee85fb063618f53f95a89e9023c4"} Sep 18 13:26:44.901543 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:26:44.901501 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c8bb48f8c-bs2kq" podStartSLOduration=2.1642428049999998 podStartE2EDuration="3.901486873s" totalImagesPullingTime="1.737244068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:26:44.90119002 +0000 UTC m=+333.808270693" watchObservedRunningTime="2026-09-18 13:26:44.901486873 +0000 UTC m=+333.808567549" Sep 18 13:27:38.810840 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.810796 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2"] Sep 18 13:27:38.814409 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.814389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:38.818724 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.818647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 18 13:27:38.820966 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.820785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 13:27:38.821095 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.821071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tdtzd\"" Sep 18 13:27:38.821467 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.821316 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 13:27:38.829410 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.829387 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2"] Sep 18 13:27:38.876970 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.876936 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-77df98bf98-4b9qj"] Sep 18 13:27:38.880569 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.880544 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:38.884941 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.884912 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 18 13:27:38.885106 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.884923 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-g7gds\"" Sep 18 13:27:38.895426 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.895319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-77df98bf98-4b9qj"] Sep 18 13:27:38.908310 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.908282 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq"] Sep 18 13:27:38.912179 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.912161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:38.950477 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.950446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfqh\" (UniqueName: \"kubernetes.io/projected/de6861c1-f533-44e1-9ea3-d75b13e55815-kube-api-access-9hfqh\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:38.950584 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.950500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de6861c1-f533-44e1-9ea3-d75b13e55815-cert\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:38.963288 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:38.963265 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq"] Sep 18 13:27:39.051783 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfqh\" (UniqueName: \"kubernetes.io/projected/de6861c1-f533-44e1-9ea3-d75b13e55815-kube-api-access-9hfqh\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:39.051963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.051963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051831 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65b797d-a1e9-4857-9606-6f45aa9b0c98-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.051963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de6861c1-f533-44e1-9ea3-d75b13e55815-cert\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:39.051963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgnm\" (UniqueName: \"kubernetes.io/projected/a65b797d-a1e9-4857-9606-6f45aa9b0c98-kube-api-access-mhgnm\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.051963 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.052137 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.051967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.052137 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:27:39.051979 2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 18 13:27:39.052137 ip-10-0-133-74 kubenswrapper[2563]: E0918 13:27:39.052048 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6861c1-f533-44e1-9ea3-d75b13e55815-cert podName:de6861c1-f533-44e1-9ea3-d75b13e55815 nodeName:}" failed. No retries permitted until 2026-09-18 13:27:39.552031822 +0000 UTC m=+388.459112461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de6861c1-f533-44e1-9ea3-d75b13e55815-cert") pod "kserve-controller-manager-7645b9c6f5-gdsz2" (UID: "de6861c1-f533-44e1-9ea3-d75b13e55815") : secret "kserve-webhook-server-cert" not found Sep 18 13:27:39.052137 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.052104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2758741a-33a7-46e2-9f94-3a08a915a07f-tls-certs\") pod \"model-serving-api-77df98bf98-4b9qj\" (UID: \"2758741a-33a7-46e2-9f94-3a08a915a07f\") " pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.052273 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.052138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.052273 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.052165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ks8z\" (UniqueName: \"kubernetes.io/projected/2758741a-33a7-46e2-9f94-3a08a915a07f-kube-api-access-7ks8z\") pod \"model-serving-api-77df98bf98-4b9qj\" (UID: \"2758741a-33a7-46e2-9f94-3a08a915a07f\") " pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.052273 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.052239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.072158 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.072093 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfqh\" (UniqueName: \"kubernetes.io/projected/de6861c1-f533-44e1-9ea3-d75b13e55815-kube-api-access-9hfqh\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:39.153132 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153265 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153265 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65b797d-a1e9-4857-9606-6f45aa9b0c98-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153364 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgnm\" (UniqueName: \"kubernetes.io/projected/a65b797d-a1e9-4857-9606-6f45aa9b0c98-kube-api-access-mhgnm\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153364 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153364 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153364 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2758741a-33a7-46e2-9f94-3a08a915a07f-tls-certs\") pod \"model-serving-api-77df98bf98-4b9qj\" (UID: \"2758741a-33a7-46e2-9f94-3a08a915a07f\") " pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.153556 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.153556 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.153397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ks8z\" (UniqueName: \"kubernetes.io/projected/2758741a-33a7-46e2-9f94-3a08a915a07f-kube-api-access-7ks8z\") pod \"model-serving-api-77df98bf98-4b9qj\" (UID: \"2758741a-33a7-46e2-9f94-3a08a915a07f\") " pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.154524 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.154490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.156076 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.156044 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65b797d-a1e9-4857-9606-6f45aa9b0c98-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.156190 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.156101 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.156190 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.156125 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2758741a-33a7-46e2-9f94-3a08a915a07f-tls-certs\") pod \"model-serving-api-77df98bf98-4b9qj\" (UID: \"2758741a-33a7-46e2-9f94-3a08a915a07f\") " pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.156290 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.156206 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.156290 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.156254 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.174782 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.174753 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ks8z\" (UniqueName: \"kubernetes.io/projected/2758741a-33a7-46e2-9f94-3a08a915a07f-kube-api-access-7ks8z\") pod \"model-serving-api-77df98bf98-4b9qj\" (UID: \"2758741a-33a7-46e2-9f94-3a08a915a07f\") " pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.174925 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.174909 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgnm\" (UniqueName: \"kubernetes.io/projected/a65b797d-a1e9-4857-9606-6f45aa9b0c98-kube-api-access-mhgnm\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.177086 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.177067 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65b797d-a1e9-4857-9606-6f45aa9b0c98-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xtllq\" (UID: \"a65b797d-a1e9-4857-9606-6f45aa9b0c98\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.197160 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.197141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:39.223539 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.223520 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:39.499270 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.499246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-77df98bf98-4b9qj"] Sep 18 13:27:39.501431 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:27:39.501406 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2758741a_33a7_46e2_9f94_3a08a915a07f.slice/crio-84a79caeb71282707132626cf99f4455ad71c5f162f8196fcc546d6be31e6a5e WatchSource:0}: Error finding container 84a79caeb71282707132626cf99f4455ad71c5f162f8196fcc546d6be31e6a5e: Status 404 returned error can't find the container with id 84a79caeb71282707132626cf99f4455ad71c5f162f8196fcc546d6be31e6a5e Sep 18 13:27:39.532140 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.532119 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq"] Sep 18 13:27:39.532873 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:27:39.532850 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65b797d_a1e9_4857_9606_6f45aa9b0c98.slice/crio-77c6ef542214ece8167866dcb7e24f367faa0e30bd17904c673331216301db38 WatchSource:0}: Error finding container 77c6ef542214ece8167866dcb7e24f367faa0e30bd17904c673331216301db38: Status 404 returned error can't find the container with id 77c6ef542214ece8167866dcb7e24f367faa0e30bd17904c673331216301db38 Sep 18 13:27:39.534892 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.534862 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 18 13:27:39.534959 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.534924 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 18 13:27:39.557527 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.557506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de6861c1-f533-44e1-9ea3-d75b13e55815-cert\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:39.559848 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.559831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de6861c1-f533-44e1-9ea3-d75b13e55815-cert\") pod \"kserve-controller-manager-7645b9c6f5-gdsz2\" (UID: \"de6861c1-f533-44e1-9ea3-d75b13e55815\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:39.729314 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:39.729281 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:40.011373 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.011320 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2"] Sep 18 13:27:40.013608 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:27:40.013575 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6861c1_f533_44e1_9ea3_d75b13e55815.slice/crio-2d39a6997cff6b0dde4d226baec23cc54794592feab458b081be75f44f9dd87a WatchSource:0}: Error finding container 2d39a6997cff6b0dde4d226baec23cc54794592feab458b081be75f44f9dd87a: Status 404 returned error can't find the container with id 2d39a6997cff6b0dde4d226baec23cc54794592feab458b081be75f44f9dd87a Sep 18 13:27:40.107059 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.106927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" event={"ID":"2758741a-33a7-46e2-9f94-3a08a915a07f","Type":"ContainerStarted","Data":"84a79caeb71282707132626cf99f4455ad71c5f162f8196fcc546d6be31e6a5e"} Sep 18 13:27:40.108567 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.108527 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" event={"ID":"de6861c1-f533-44e1-9ea3-d75b13e55815","Type":"ContainerStarted","Data":"2d39a6997cff6b0dde4d226baec23cc54794592feab458b081be75f44f9dd87a"} Sep 18 13:27:40.111011 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.110944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" event={"ID":"a65b797d-a1e9-4857-9606-6f45aa9b0c98","Type":"ContainerStarted","Data":"7c700497ba49f1617cc5336db2cc3326814e43fd8ce09c7ec9d2d0a35edf418d"} Sep 18 13:27:40.111011 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.110989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" event={"ID":"a65b797d-a1e9-4857-9606-6f45aa9b0c98","Type":"ContainerStarted","Data":"77c6ef542214ece8167866dcb7e24f367faa0e30bd17904c673331216301db38"} Sep 18 13:27:40.111190 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.111110 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:40.112871 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.112846 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-xtllq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 18 13:27:40.113011 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.112926 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" podUID="a65b797d-a1e9-4857-9606-6f45aa9b0c98" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:27:40.145307 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:40.145250 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" podStartSLOduration=2.145230411 podStartE2EDuration="2.145230411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:27:40.142984694 +0000 UTC m=+389.050065355" watchObservedRunningTime="2026-09-18 13:27:40.145230411 +0000 UTC m=+389.052311072" Sep 18 13:27:41.118991 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:41.118964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xtllq" Sep 18 13:27:41.190622 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:41.190599 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp"] Sep 18 13:27:41.190850 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:41.190814 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" podUID="98d3d541-b0ab-494f-9311-97acf5235957" containerName="discovery" containerID="cri-o://87da72e55e63a04a1ba06a11de25ea8d8ed8d0627d0c1e352e730191f10e2bfc" gracePeriod=30 Sep 18 13:27:42.125526 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.125476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" event={"ID":"2758741a-33a7-46e2-9f94-3a08a915a07f","Type":"ContainerStarted","Data":"5c876971f0d7dd5ac3e48a38c431eb3f7132650bcae017896ba9d47230811e91"} Sep 18 13:27:42.125991 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.125700 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:27:42.127600 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.127578 2563 generic.go:356] "Generic (PLEG): container finished" podID="98d3d541-b0ab-494f-9311-97acf5235957" containerID="87da72e55e63a04a1ba06a11de25ea8d8ed8d0627d0c1e352e730191f10e2bfc" exitCode=0 Sep 18 13:27:42.127752 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.127632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" event={"ID":"98d3d541-b0ab-494f-9311-97acf5235957","Type":"ContainerDied","Data":"87da72e55e63a04a1ba06a11de25ea8d8ed8d0627d0c1e352e730191f10e2bfc"} Sep 18 13:27:42.146375 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.146319 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" podStartSLOduration=2.548256272 podStartE2EDuration="4.146299277s" totalImagesPullingTime="1.598043005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:27:42.145755435 +0000 UTC m=+391.052836096" watchObservedRunningTime="2026-09-18 13:27:42.146299277 +0000 UTC m=+391.053379939" Sep 18 13:27:42.584027 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.584005 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:27:42.684832 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.684810 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-cacerts\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.684940 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.684851 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-kubeconfig\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.684940 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.684886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-dns-cert\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.685046 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.684974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d3d541-b0ab-494f-9311-97acf5235957-local-certs\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.685046 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.685009 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-ca-configmap\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.685152 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.685060 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-istio-token\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.685152 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.685092 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ggmt\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-kube-api-access-6ggmt\") pod \"98d3d541-b0ab-494f-9311-97acf5235957\" (UID: \"98d3d541-b0ab-494f-9311-97acf5235957\") " Sep 18 13:27:42.685551 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.685519 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:27:42.687734 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.687697 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-istio-token" (OuterVolumeSpecName: "istio-token") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:27:42.687839 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.687800 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d3d541-b0ab-494f-9311-97acf5235957-local-certs" (OuterVolumeSpecName: "local-certs") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:27:42.687839 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.687816 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:27:42.687933 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.687866 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-cacerts" (OuterVolumeSpecName: "cacerts") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:27:42.687933 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.687879 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:27:42.688002 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.687961 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-kube-api-access-6ggmt" (OuterVolumeSpecName: "kube-api-access-6ggmt") pod "98d3d541-b0ab-494f-9311-97acf5235957" (UID: "98d3d541-b0ab-494f-9311-97acf5235957"). InnerVolumeSpecName "kube-api-access-6ggmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:27:42.786627 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786593 2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98d3d541-b0ab-494f-9311-97acf5235957-local-certs\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:42.786627 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786622 2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-ca-configmap\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:42.786627 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786633 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-istio-token\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:42.786885 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786641 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ggmt\" (UniqueName: \"kubernetes.io/projected/98d3d541-b0ab-494f-9311-97acf5235957-kube-api-access-6ggmt\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:42.786885 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786649 2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-cacerts\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:42.786885 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786658 2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-kubeconfig\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:42.786885 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:42.786667 2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98d3d541-b0ab-494f-9311-97acf5235957-istio-csr-dns-cert\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\"" Sep 18 13:27:43.134870 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.134836 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" event={"ID":"de6861c1-f533-44e1-9ea3-d75b13e55815","Type":"ContainerStarted","Data":"f93a04d6e960631bbec091ae8aba814a2bd6e2d24a558690a67707dcb1fba7b2"} Sep 18 13:27:43.135305 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.134900 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:27:43.136182 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.136160 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" Sep 18 13:27:43.136294 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.136208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp" event={"ID":"98d3d541-b0ab-494f-9311-97acf5235957","Type":"ContainerDied","Data":"9a910f30ba6f294b2920ba2afed5183ef0eb4b809f070d1b04e2a8ffdbac3453"} Sep 18 13:27:43.136294 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.136258 2563 scope.go:117] "RemoveContainer" containerID="87da72e55e63a04a1ba06a11de25ea8d8ed8d0627d0c1e352e730191f10e2bfc" Sep 18 13:27:43.156177 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.156133 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" podStartSLOduration=2.551761178 podStartE2EDuration="5.15611712s" totalImagesPullingTime="2.604355942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:27:43.153991669 +0000 UTC m=+392.061072340" watchObservedRunningTime="2026-09-18 13:27:43.15611712 +0000 UTC m=+392.063197780" Sep 18 13:27:43.168493 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.168467 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp"] Sep 18 13:27:43.172747 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.172728 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4hnxp"] Sep 18 13:27:43.378395 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:43.378364 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d3d541-b0ab-494f-9311-97acf5235957" path="/var/lib/kubelet/pods/98d3d541-b0ab-494f-9311-97acf5235957/volumes" Sep 18 13:27:53.140909 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:27:53.140875 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-77df98bf98-4b9qj" Sep 18 13:28:14.147210 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:14.147181 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7645b9c6f5-gdsz2" Sep 18 13:28:24.328251 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.328170 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d88b9c88-vjrlw"] Sep 18 13:28:24.328851 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.328809 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d3d541-b0ab-494f-9311-97acf5235957" containerName="discovery" Sep 18 13:28:24.328851 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.328844 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d3d541-b0ab-494f-9311-97acf5235957" containerName="discovery" Sep 18 13:28:24.329033 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.328950 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d3d541-b0ab-494f-9311-97acf5235957" containerName="discovery" Sep 18 13:28:24.331447 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.331423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.334279 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.334253 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 13:28:24.334279 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.334270 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 13:28:24.335497 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.335475 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 13:28:24.335608 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.335530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 13:28:24.335740 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.335721 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hzpsh\"" Sep 18 13:28:24.335819 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.335757 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 13:28:24.335873 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.335822 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 13:28:24.337007 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.336972 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 13:28:24.340636 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.340617 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 13:28:24.342552 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.342527 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d88b9c88-vjrlw"] Sep 18 13:28:24.432404 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-service-ca\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.432574 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/018ced02-51d7-4429-91c2-89d0f701c5a1-console-serving-cert\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.432574 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qnrq\" (UniqueName: \"kubernetes.io/projected/018ced02-51d7-4429-91c2-89d0f701c5a1-kube-api-access-6qnrq\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.432574 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/018ced02-51d7-4429-91c2-89d0f701c5a1-console-oauth-config\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.432574 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-trusted-ca-bundle\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.432574 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-oauth-serving-cert\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.432756 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.432587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-console-config\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.533828 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.533795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qnrq\" (UniqueName: \"kubernetes.io/projected/018ced02-51d7-4429-91c2-89d0f701c5a1-kube-api-access-6qnrq\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.533964 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.533839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/018ced02-51d7-4429-91c2-89d0f701c5a1-console-oauth-config\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.533964 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.533854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-trusted-ca-bundle\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.533964 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.533884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-oauth-serving-cert\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.534092 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-console-config\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.534595 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-service-ca\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.534595 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/018ced02-51d7-4429-91c2-89d0f701c5a1-console-serving-cert\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.534831 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534705 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-oauth-serving-cert\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.534831 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534786 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-console-config\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.534831 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-trusted-ca-bundle\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.535002 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.534984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/018ced02-51d7-4429-91c2-89d0f701c5a1-service-ca\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.536461 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.536440 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/018ced02-51d7-4429-91c2-89d0f701c5a1-console-oauth-config\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.536866 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.536850 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/018ced02-51d7-4429-91c2-89d0f701c5a1-console-serving-cert\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.543764 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.543741 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qnrq\" (UniqueName: \"kubernetes.io/projected/018ced02-51d7-4429-91c2-89d0f701c5a1-kube-api-access-6qnrq\") pod \"console-85d88b9c88-vjrlw\" (UID: \"018ced02-51d7-4429-91c2-89d0f701c5a1\") " pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.643266 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.643242 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:24.918540 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:24.918510 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d88b9c88-vjrlw"] Sep 18 13:28:24.921412 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:28:24.921381 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018ced02_51d7_4429_91c2_89d0f701c5a1.slice/crio-522a975288fd90151ce158908ca96b727494bdc0f7b61a4960d5ebabdfc9fbee WatchSource:0}: Error finding container 522a975288fd90151ce158908ca96b727494bdc0f7b61a4960d5ebabdfc9fbee: Status 404 returned error can't find the container with id 522a975288fd90151ce158908ca96b727494bdc0f7b61a4960d5ebabdfc9fbee Sep 18 13:28:25.326300 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:25.326208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d88b9c88-vjrlw" event={"ID":"018ced02-51d7-4429-91c2-89d0f701c5a1","Type":"ContainerStarted","Data":"4744b736cc4e3dd70681fa7386c103b2784c5f73d68a520b91984916651ef492"} Sep 18 13:28:25.326300 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:25.326259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d88b9c88-vjrlw" event={"ID":"018ced02-51d7-4429-91c2-89d0f701c5a1","Type":"ContainerStarted","Data":"522a975288fd90151ce158908ca96b727494bdc0f7b61a4960d5ebabdfc9fbee"} Sep 18 13:28:25.350030 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:25.349981 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d88b9c88-vjrlw" podStartSLOduration=1.349965496 podStartE2EDuration="1.349965496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:25.347990903 +0000 UTC m=+434.255071575" watchObservedRunningTime="2026-09-18 13:28:25.349965496 +0000 UTC m=+434.257046156" Sep 18 13:28:34.643803 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:34.643769 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:34.644181 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:34.643855 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:34.648629 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:34.648606 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:28:35.377949 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:28:35.377920 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85d88b9c88-vjrlw" Sep 18 13:31:13.276131 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:31:13.276107 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:31:13.280840 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:31:13.280817 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:36:13.305826 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:36:13.305798 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:36:13.310894 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:36:13.310870 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:37:00.864001 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:00.863970 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7645b9c6f5-gdsz2_de6861c1-f533-44e1-9ea3-d75b13e55815/manager/0.log" Sep 18 13:37:01.219611 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:01.219590 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-77df98bf98-4b9qj_2758741a-33a7-46e2-9f94-3a08a915a07f/server/0.log" Sep 18 13:37:03.000954 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:03.000925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xtllq_a65b797d-a1e9-4857-9606-6f45aa9b0c98/discovery/0.log" Sep 18 13:37:03.111319 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:03.111290 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8bb48f8c-bs2kq_0e4f9513-0941-4366-bf0e-67bfb576bec1/kube-auth-proxy/0.log" Sep 18 13:37:12.764285 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:12.764254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rnvc5_a38650e3-2986-4c1f-a83b-9559ae7fbcff/global-pull-secret-syncer/0.log" Sep 18 13:37:12.910738 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:12.910695 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s8ppl_6a6e5ed1-5978-4c60-b6eb-2b86749d34fc/konnectivity-agent/0.log" Sep 18 13:37:12.955564 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:12.955540 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-74.ec2.internal_471380efb1dd06918a8b1c45701cf938/haproxy/0.log" Sep 18 13:37:18.820847 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.820817 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/alertmanager/0.log" Sep 18 13:37:18.855837 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.855813 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/config-reloader/0.log" Sep 18 13:37:18.883953 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.883930 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/kube-rbac-proxy-web/0.log" Sep 18 13:37:18.910195 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.910176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/kube-rbac-proxy/0.log" Sep 18 13:37:18.934077 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.934054 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/kube-rbac-proxy-metric/0.log" Sep 18 13:37:18.961876 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.961856 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/prom-label-proxy/0.log" Sep 18 13:37:18.985470 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:18.985449 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cc99501-c4e1-46b8-b39c-1332310aebdf/init-config-reloader/0.log" Sep 18 13:37:19.460441 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:19.460419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbdmf_8e24e372-8f67-4049-abd0-daa8b131aae9/node-exporter/0.log" Sep 18 13:37:19.481570 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:19.481550 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbdmf_8e24e372-8f67-4049-abd0-daa8b131aae9/kube-rbac-proxy/0.log" Sep 18 13:37:19.506180 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:19.506153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbdmf_8e24e372-8f67-4049-abd0-daa8b131aae9/init-textfile/0.log" Sep 18 13:37:19.948133 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:19.948104 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c98b7dcc7-gnpt4_bc25fd1e-2580-431c-ac55-a0930e74d5ba/telemeter-client/0.log" Sep 18 13:37:19.973362 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:19.973336 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c98b7dcc7-gnpt4_bc25fd1e-2580-431c-ac55-a0930e74d5ba/reload/0.log" Sep 18 13:37:20.013096 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.013073 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c98b7dcc7-gnpt4_bc25fd1e-2580-431c-ac55-a0930e74d5ba/kube-rbac-proxy/0.log" Sep 18 13:37:20.050049 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.050024 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d899dc46d-wjcf9_face2844-8901-42b7-a9e1-40854921ea56/thanos-query/0.log" Sep 18 13:37:20.076971 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.076951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d899dc46d-wjcf9_face2844-8901-42b7-a9e1-40854921ea56/kube-rbac-proxy-web/0.log" Sep 18 13:37:20.105257 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.105233 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d899dc46d-wjcf9_face2844-8901-42b7-a9e1-40854921ea56/kube-rbac-proxy/0.log" Sep 18 13:37:20.130781 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.130759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d899dc46d-wjcf9_face2844-8901-42b7-a9e1-40854921ea56/prom-label-proxy/0.log" Sep 18 13:37:20.156224 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.156204 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d899dc46d-wjcf9_face2844-8901-42b7-a9e1-40854921ea56/kube-rbac-proxy-rules/0.log" Sep 18 13:37:20.181792 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:20.181768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d899dc46d-wjcf9_face2844-8901-42b7-a9e1-40854921ea56/kube-rbac-proxy-metrics/0.log" Sep 18 13:37:22.001085 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.001050 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8"] Sep 18 13:37:22.009366 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.009330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.012284 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.012249 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2qghq\"/\"kube-root-ca.crt\"" Sep 18 13:37:22.013344 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.013318 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2qghq\"/\"openshift-service-ca.crt\"" Sep 18 13:37:22.013469 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.013323 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2qghq\"/\"default-dockercfg-ct6h4\"" Sep 18 13:37:22.013931 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.013912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/2.log" Sep 18 13:37:22.014068 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.014049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8"] Sep 18 13:37:22.022218 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.022199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-56jh2_04d37d2e-920f-438a-9164-83583ea3db84/console-operator/3.log" Sep 18 13:37:22.102359 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.102333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-lib-modules\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.102542 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.102381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-podres\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.102542 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.102472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-sys\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.102542 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.102535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f55mt\" (UniqueName: \"kubernetes.io/projected/869c99cf-40a5-4d34-858a-7e7931b7fd2b-kube-api-access-f55mt\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.102725 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.102569 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-proc\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203564 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-podres\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-sys\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203653 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-sys\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203730 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f55mt\" (UniqueName: \"kubernetes.io/projected/869c99cf-40a5-4d34-858a-7e7931b7fd2b-kube-api-access-f55mt\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203879 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-proc\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203879 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203756 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-podres\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203879 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-proc\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.203879 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-lib-modules\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.204003 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.203914 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/869c99cf-40a5-4d34-858a-7e7931b7fd2b-lib-modules\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.212944 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.212922 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f55mt\" (UniqueName: \"kubernetes.io/projected/869c99cf-40a5-4d34-858a-7e7931b7fd2b-kube-api-access-f55mt\") pod \"perf-node-gather-daemonset-qlml8\" (UID: \"869c99cf-40a5-4d34-858a-7e7931b7fd2b\") " pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.321853 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.321776 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:22.598057 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.598034 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8"] Sep 18 13:37:22.601186 ip-10-0-133-74 kubenswrapper[2563]: W0918 13:37:22.601151 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod869c99cf_40a5_4d34_858a_7e7931b7fd2b.slice/crio-d7179f59e777b1eb2cbc9a8841c6b260ce037d2f0183baae42fa41dfb57f947d WatchSource:0}: Error finding container d7179f59e777b1eb2cbc9a8841c6b260ce037d2f0183baae42fa41dfb57f947d: Status 404 returned error can't find the container with id d7179f59e777b1eb2cbc9a8841c6b260ce037d2f0183baae42fa41dfb57f947d Sep 18 13:37:22.639516 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.639479 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85d88b9c88-vjrlw_018ced02-51d7-4429-91c2-89d0f701c5a1/console/0.log" Sep 18 13:37:22.675270 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:22.675215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" event={"ID":"869c99cf-40a5-4d34-858a-7e7931b7fd2b","Type":"ContainerStarted","Data":"d7179f59e777b1eb2cbc9a8841c6b260ce037d2f0183baae42fa41dfb57f947d"} Sep 18 13:37:23.684877 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:23.684842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" event={"ID":"869c99cf-40a5-4d34-858a-7e7931b7fd2b","Type":"ContainerStarted","Data":"131438829cad7561220c3070355763cc10fb1ad4cacc484e84a0761208b040f9"} Sep 18 13:37:23.685273 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:23.684958 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:23.712343 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:23.712295 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" podStartSLOduration=2.71227945 podStartE2EDuration="2.71227945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:37:23.711168146 +0000 UTC m=+972.618248818" watchObservedRunningTime="2026-09-18 13:37:23.71227945 +0000 UTC m=+972.619360111" Sep 18 13:37:24.582453 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:24.582417 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t88fv_7b356376-6131-45ec-96cf-32ccebf858c4/dns/0.log" Sep 18 13:37:24.608559 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:24.608536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t88fv_7b356376-6131-45ec-96cf-32ccebf858c4/kube-rbac-proxy/0.log" Sep 18 13:37:24.726436 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:24.726409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jwgfh_5b5996a5-2a7d-4702-8837-0c1d63b28b29/dns-node-resolver/0.log" Sep 18 13:37:25.416348 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:25.416319 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56885fd79-nv7sr_e3f64119-7f94-4fe0-8418-029bbbddae5a/registry/0.log" Sep 18 13:37:25.471850 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:25.471824 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnqlz_f762345d-70e3-46d9-a52d-477f85f73b46/node-ca/0.log" Sep 18 13:37:26.590863 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:26.590836 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xtllq_a65b797d-a1e9-4857-9606-6f45aa9b0c98/discovery/0.log" Sep 18 13:37:26.613193 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:26.613176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8bb48f8c-bs2kq_0e4f9513-0941-4366-bf0e-67bfb576bec1/kube-auth-proxy/0.log" Sep 18 13:37:27.426051 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:27.426017 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlx6c_4b1e2214-b651-428e-9d33-63ab32e00730/serve-healthcheck-canary/0.log" Sep 18 13:37:27.978051 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:27.978017 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-5d2bt_20fb5c48-58fd-48b3-ac86-0c46e8432bc4/insights-operator/1.log" Sep 18 13:37:27.978427 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:27.978136 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-5d2bt_20fb5c48-58fd-48b3-ac86-0c46e8432bc4/insights-operator/0.log" Sep 18 13:37:28.001556 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:28.001536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dx6x_f1263944-d7dd-4687-86d9-da9ddb4e0604/kube-rbac-proxy/0.log" Sep 18 13:37:28.031526 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:28.031503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dx6x_f1263944-d7dd-4687-86d9-da9ddb4e0604/exporter/0.log" Sep 18 13:37:28.061309 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:28.061285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dx6x_f1263944-d7dd-4687-86d9-da9ddb4e0604/extractor/0.log" Sep 18 13:37:29.699785 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:29.699759 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2qghq/perf-node-gather-daemonset-qlml8" Sep 18 13:37:30.651780 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:30.651756 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-67d4494bfd-9hsqh_db847fb3-90db-4bd5-8895-95308f36e80a/manager/0.log" Sep 18 13:37:30.681452 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:30.681428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-67d4494bfd-9hsqh_db847fb3-90db-4bd5-8895-95308f36e80a/copy-manifests/0.log" Sep 18 13:37:31.170324 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:31.170296 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xtllq_a65b797d-a1e9-4857-9606-6f45aa9b0c98/discovery/0.log" Sep 18 13:37:31.193864 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:31.193844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8bb48f8c-bs2kq_0e4f9513-0941-4366-bf0e-67bfb576bec1/kube-auth-proxy/0.log" Sep 18 13:37:32.537188 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:32.537161 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xtllq_a65b797d-a1e9-4857-9606-6f45aa9b0c98/discovery/0.log" Sep 18 13:37:32.547983 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:32.547965 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8bb48f8c-bs2kq_0e4f9513-0941-4366-bf0e-67bfb576bec1/kube-auth-proxy/0.log" Sep 18 13:37:32.858636 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:32.858566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7645b9c6f5-gdsz2_de6861c1-f533-44e1-9ea3-d75b13e55815/manager/0.log" Sep 18 13:37:32.955310 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:32.955284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-77df98bf98-4b9qj_2758741a-33a7-46e2-9f94-3a08a915a07f/server/0.log" Sep 18 13:37:37.881645 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:37.881607 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ktqq9_48e14527-b584-4bba-891f-aef2c99d89b7/migrator/0.log" Sep 18 13:37:37.906738 ip-10-0-133-74 kubenswrapper[2563]: I0918 13:37:37.906714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ktqq9_48e14527-b584-4bba-891f-aef2c99d89b7/graceful-termination/0.log"