May 21 14:39:38.201824 ip-10-0-131-210 systemd[1]: Starting Kubernetes Kubelet... May 21 14:39:38.673182 ip-10-0-131-210 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:39:38.673182 ip-10-0-131-210 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:39:38.673182 ip-10-0-131-210 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:39:38.673182 ip-10-0-131-210 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:39:38.673182 ip-10-0-131-210 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:39:38.674999 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.674867 2553 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:39:38.678806 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678786 2553 feature_gate.go:328] unrecognized feature gate: Example May 21 14:39:38.678806 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678803 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:39:38.678806 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678808 2553 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:39:38.678806 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678812 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678816 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678823 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678828 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678832 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678836 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678839 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678843 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678846 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678851 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678855 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678859 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678862 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678866 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678879 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678883 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678887 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678894 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678900 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:39:38.679062 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678908 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678913 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678917 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678922 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678927 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678931 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678935 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678939 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678943 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678948 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678952 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678958 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678965 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678970 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678974 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678980 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678984 2553 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678989 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678993 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:39:38.679861 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.678998 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679002 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679007 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679012 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679017 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679021 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679025 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679030 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679034 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679040 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679045 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679050 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679054 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679058 2553 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679062 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679065 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679069 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679073 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679077 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679082 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:39:38.680638 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679086 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679089 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679094 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679098 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679102 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679115 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679120 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679125 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679131 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679135 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679140 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679144 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679148 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679153 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679157 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679161 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679164 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679168 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679172 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679177 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:39:38.681165 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679183 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679188 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679192 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679197 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679201 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679978 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679989 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679994 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.679999 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680003 2553 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680007 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680013 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680017 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680021 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680025 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680029 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680033 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680039 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680044 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:39:38.681672 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680048 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680054 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680059 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680063 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680067 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680072 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680076 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680080 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680084 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680088 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680092 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680097 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680101 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680105 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680109 2553 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680113 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680118 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680122 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680125 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680130 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:39:38.682126 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680134 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680138 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680142 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680149 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680155 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680160 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680166 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680171 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680175 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680179 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680183 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680189 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680193 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680198 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680202 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680206 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680210 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680214 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680219 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:39:38.682642 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680222 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680226 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680230 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680234 2553 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680238 2553 feature_gate.go:328] unrecognized feature gate: Example May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680242 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680246 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680251 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680255 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680259 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680263 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680267 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680271 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680275 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680280 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680283 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680288 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680292 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680296 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680301 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:39:38.683113 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680305 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680309 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680313 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680317 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680321 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680326 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680331 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680336 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680340 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680344 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680350 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680357 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.680363 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680476 2553 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680505 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680517 2553 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680524 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680539 2553 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680544 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680553 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680560 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:39:38.683622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680613 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680618 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680622 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680627 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680631 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680634 2553 flags.go:64] FLAG: --cgroup-root="" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680638 2553 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680642 2553 flags.go:64] FLAG: --client-ca-file="" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680645 2553 flags.go:64] FLAG: --cloud-config="" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680649 2553 flags.go:64] FLAG: --cloud-provider="external" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680653 2553 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680660 2553 flags.go:64] FLAG: --cluster-domain="" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680663 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680667 2553 flags.go:64] FLAG: --config-dir="" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680669 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680673 2553 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680678 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680682 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680685 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680689 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680692 2553 flags.go:64] FLAG: --contention-profiling="false" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680695 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680698 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680702 2553 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680705 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:39:38.684137 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680710 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680713 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680716 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680718 2553 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680722 2553 flags.go:64] FLAG: --enable-server="true" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680725 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680730 2553 flags.go:64] FLAG: --event-burst="100" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680738 2553 flags.go:64] FLAG: --event-qps="50" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680742 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680745 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680749 2553 flags.go:64] FLAG: --eviction-hard="" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680753 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680756 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680759 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680762 2553 flags.go:64] FLAG: --eviction-soft="" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680765 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680768 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680771 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680774 2553 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680778 2553 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680780 2553 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680784 2553 flags.go:64] FLAG: --feature-gates="" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680788 2553 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680791 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680795 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:39:38.684757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680798 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680801 2553 flags.go:64] FLAG: --healthz-port="10248" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680805 2553 flags.go:64] FLAG: --help="false" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680807 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-131-210.ec2.internal" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680810 2553 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680813 2553 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680819 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680823 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680827 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680830 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680832 2553 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680835 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680839 2553 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680842 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680847 2553 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680849 2553 flags.go:64] FLAG: --kube-reserved="" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680853 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680857 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680860 2553 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680863 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680865 2553 flags.go:64] FLAG: --lock-file="" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680868 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680871 2553 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680875 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:39:38.685354 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680881 2553 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680884 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680887 2553 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680890 2553 flags.go:64] FLAG: --logging-format="text" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680893 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680897 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680900 2553 flags.go:64] FLAG: --manifest-url="" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680903 2553 flags.go:64] FLAG: --manifest-url-header="" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680908 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680911 2553 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680916 2553 flags.go:64] FLAG: --max-pods="110" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680919 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680922 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680925 2553 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680929 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680932 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680935 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680938 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680949 2553 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680952 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680956 2553 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680959 2553 flags.go:64] FLAG: --pod-cidr="" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680963 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:39:38.686010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680970 2553 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680973 2553 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680978 2553 flags.go:64] FLAG: --pods-per-core="0" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680981 2553 flags.go:64] FLAG: --port="10250" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680984 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680987 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0742dd313ce356579" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680991 2553 flags.go:64] FLAG: --qos-reserved="" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680994 2553 flags.go:64] FLAG: --read-only-port="10255" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.680997 2553 flags.go:64] FLAG: --register-node="true" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681000 2553 flags.go:64] FLAG: --register-schedulable="true" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681003 2553 flags.go:64] FLAG: --register-with-taints="" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681006 2553 flags.go:64] FLAG: --registry-burst="10" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681009 2553 flags.go:64] FLAG: --registry-qps="5" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681012 2553 flags.go:64] FLAG: --reserved-cpus="" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681015 2553 flags.go:64] FLAG: --reserved-memory="" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681019 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681022 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681025 2553 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681028 2553 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681031 2553 flags.go:64] FLAG: --runonce="false" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681034 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681037 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681040 2553 flags.go:64] FLAG: --seccomp-default="false" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681043 2553 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681047 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681051 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:39:38.686593 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681054 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681057 2553 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681060 2553 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681063 2553 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681066 2553 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681071 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681075 2553 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681077 2553 flags.go:64] FLAG: --system-cgroups="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681080 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681088 2553 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681091 2553 flags.go:64] FLAG: --tls-cert-file="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681094 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681099 2553 flags.go:64] FLAG: --tls-min-version="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681102 2553 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681105 2553 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681108 2553 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681111 2553 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681115 2553 flags.go:64] FLAG: --v="2" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681119 2553 flags.go:64] FLAG: --version="false" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681123 2553 flags.go:64] FLAG: --vmodule="" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681127 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.681131 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681242 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681247 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:39:38.687201 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681251 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681254 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681257 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681259 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681263 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681266 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681270 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681273 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681276 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681279 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681281 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681284 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681286 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681290 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681292 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681295 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681299 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681301 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681305 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681309 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:39:38.687825 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681313 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681315 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681318 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681321 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681323 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681326 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681329 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681331 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681334 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681337 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681339 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681342 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681345 2553 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681347 2553 feature_gate.go:328] unrecognized feature gate: Example May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681350 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681352 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681355 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681357 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681361 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681363 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:39:38.688340 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681366 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681370 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681374 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681377 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681380 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681384 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681386 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681389 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681392 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681394 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681397 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681404 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681408 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681410 2553 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681413 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681416 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681419 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681421 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681424 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:39:38.688870 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681427 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681429 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681432 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681435 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681437 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681440 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681443 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681446 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681448 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681451 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681453 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681457 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681460 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681463 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681466 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681468 2553 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681471 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681473 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681476 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681479 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:39:38.689426 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681481 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681484 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681487 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681503 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.681506 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.682168 2553 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.688984 2553 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.689006 2553 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689056 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689062 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689066 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689069 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689072 2553 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689076 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689079 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:39:38.689935 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689081 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689084 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689087 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689090 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689092 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689095 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689098 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689100 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689103 2553 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689106 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689109 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689112 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689114 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689117 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689119 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689122 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689124 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689127 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689130 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689133 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:39:38.690324 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689136 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689138 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689141 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689143 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689147 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689150 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689153 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689155 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689158 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689161 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689163 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689166 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689168 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689171 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689173 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689176 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689178 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689181 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689183 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689185 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:39:38.690824 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689188 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689191 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689193 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689196 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689198 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689201 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689205 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689210 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689213 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689216 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689219 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689222 2553 feature_gate.go:328] unrecognized feature gate: Example May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689224 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689227 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689230 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689232 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689236 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689241 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689245 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:39:38.691316 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689248 2553 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689250 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689253 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689256 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689258 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689261 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689263 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689266 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689269 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689271 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689274 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689276 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689279 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689281 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689284 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689287 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689289 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689292 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689294 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:39:38.691811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689297 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.689303 2553 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689427 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689434 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689437 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689441 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689444 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689446 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689449 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689452 2553 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689455 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689458 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689462 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689466 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689470 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:39:38.692269 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689473 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689476 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689479 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689481 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689484 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689487 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689505 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689508 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689511 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689514 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689516 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689519 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689522 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689525 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689528 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689531 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689533 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689536 2553 feature_gate.go:328] unrecognized feature gate: Example May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689539 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689541 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:39:38.692662 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689545 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689548 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689550 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689553 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689556 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689558 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689561 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689564 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689568 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689570 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689574 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689577 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689580 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689582 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689585 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689587 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689590 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689593 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689596 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:39:38.693207 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689599 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689601 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689604 2553 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689607 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689609 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689612 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689614 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689617 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689619 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689622 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689625 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689627 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689630 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689633 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689635 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689638 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689641 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689643 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689646 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:39:38.693706 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689648 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689651 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689655 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689657 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689660 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689664 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689667 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689669 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689672 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689675 2553 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689677 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689680 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689682 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689685 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:38.689687 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.689692 2553 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:39:38.694176 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.690484 2553 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:39:38.694585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.692561 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:39:38.694585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.693584 2553 server.go:1019] "Starting client certificate rotation" May 21 14:39:38.694585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.693686 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:39:38.694585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.694305 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:39:38.720659 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.720632 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:39:38.725947 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.725918 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:39:38.741211 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.741181 2553 log.go:25] "Validated CRI v1 runtime API" May 21 14:39:38.747017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.746990 2553 log.go:25] "Validated CRI v1 image API" May 21 14:39:38.748383 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.748362 2553 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:39:38.752463 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.752440 2553 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:39:38.753321 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.753292 2553 fs.go:135] Filesystem UUIDs: map[6542856e-2af9-4f16-8793-88659af37b76:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 db4c9aa3-826a-44fb-870e-397ed452490a:/dev/nvme0n1p3] May 21 14:39:38.753401 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.753320 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:39:38.757838 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.757712 2553 manager.go:217] Machine: {Timestamp:2026-05-21 14:39:38.757180587 +0000 UTC m=+0.427430672 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097591 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5e6167955744bbc63f99480940d5 SystemUUID:ec2e5e61-6795-5744-bbc6-3f99480940d5 BootID:65ef1ff5-c21c-4d9c-8aab-31f2691206b9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:ea:6e:8f:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:ea:6e:8f:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:13:73:45:3d:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:39:38.757838 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.757836 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:39:38.757955 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.757926 2553 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:39:38.759963 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.759929 2553 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:39:38.760110 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.759966 2553 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-210.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:39:38.760157 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.760120 2553 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:39:38.760157 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.760129 2553 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:39:38.760157 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.760137 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:39:38.760157 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.760152 2553 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:39:38.761652 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.761641 2553 state_mem.go:36] "Initialized new in-memory state store" May 21 14:39:38.761767 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.761758 2553 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:39:38.764232 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.764222 2553 kubelet.go:491] "Attempting to sync node with API server" May 21 14:39:38.764272 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.764236 2553 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:39:38.764975 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.764964 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:39:38.765012 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.764981 2553 kubelet.go:397] "Adding apiserver pod source" May 21 14:39:38.765012 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.764991 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:39:38.766088 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.766075 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:39:38.766138 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.766096 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:39:38.769584 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.769563 2553 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:39:38.771681 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.771666 2553 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:39:38.772685 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772672 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:39:38.772733 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772693 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:39:38.772733 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772703 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:39:38.772733 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772712 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:39:38.772733 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772723 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:39:38.772733 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772733 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:39:38.772863 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772741 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:39:38.772863 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772749 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:39:38.772863 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772759 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:39:38.772863 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772768 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:39:38.772981 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.772951 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:39:38.774763 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.774735 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4s2pf" May 21 14:39:38.774856 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.774743 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:39:38.774994 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.774978 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:39:38.775048 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.775012 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:39:38.776756 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.776714 2553 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:39:38.776756 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.776732 2553 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:39:38.778643 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.778625 2553 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:39:38.778724 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.778674 2553 server.go:1295] "Started kubelet" May 21 14:39:38.778804 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.778753 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:39:38.779453 ip-10-0-131-210 systemd[1]: Started Kubernetes Kubelet. May 21 14:39:38.780029 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.779508 2553 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:39:38.780029 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.779592 2553 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:39:38.780694 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.780682 2553 server.go:317] "Adding debug handlers to kubelet server" May 21 14:39:38.780888 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.780871 2553 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:39:38.781149 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.781129 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4s2pf" May 21 14:39:38.787703 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.787685 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:39:38.788211 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.788194 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:39:38.788359 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.788341 2553 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:39:38.788359 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.788355 2553 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:39:38.788774 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.788758 2553 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:39:38.789283 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.789262 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:38.789435 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.789416 2553 reconstruct.go:97] "Volume reconstruction finished" May 21 14:39:38.789519 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.789437 2553 reconciler.go:26] "Reconciler: start to sync state" May 21 14:39:38.789754 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.789708 2553 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:39:38.789881 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.789849 2553 factory.go:55] Registering systemd factory May 21 14:39:38.789881 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.789883 2553 factory.go:223] Registration of the systemd container factory successfully May 21 14:39:38.790183 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.790168 2553 factory.go:153] Registering CRI-O factory May 21 14:39:38.790183 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.790183 2553 factory.go:223] Registration of the crio container factory successfully May 21 14:39:38.790334 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.790231 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:39:38.790334 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.790246 2553 factory.go:103] Registering Raw factory May 21 14:39:38.790334 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.790261 2553 manager.go:1196] Started watching for new ooms in manager May 21 14:39:38.790973 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.790959 2553 manager.go:319] Starting recovery of all containers May 21 14:39:38.791195 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.791179 2553 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:39:38.795440 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.795422 2553 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-210.ec2.internal" not found May 21 14:39:38.795440 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.795422 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-210.ec2.internal\" not found" node="ip-10-0-131-210.ec2.internal" May 21 14:39:38.802991 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.802969 2553 manager.go:324] Recovery completed May 21 14:39:38.807839 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.807824 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:39:38.809812 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.809797 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientMemory" May 21 14:39:38.809872 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.809827 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:39:38.809872 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.809837 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientPID" May 21 14:39:38.810318 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.810306 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:39:38.810361 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.810319 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:39:38.810361 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.810340 2553 state_mem.go:36] "Initialized new in-memory state store" May 21 14:39:38.812513 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.812358 2553 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-210.ec2.internal" not found May 21 14:39:38.813377 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.813363 2553 policy_none.go:49] "None policy: Start" May 21 14:39:38.813414 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.813384 2553 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:39:38.813414 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.813398 2553 state_mem.go:35] "Initializing new in-memory state store" May 21 14:39:38.853201 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853181 2553 manager.go:341] "Starting Device Plugin manager" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.853218 2553 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853229 2553 server.go:85] "Starting device plugin registration server" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853570 2553 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853583 2553 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853675 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853783 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.853795 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.854369 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:39:38.862431 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.854406 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:38.869422 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.869404 2553 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-210.ec2.internal" not found May 21 14:39:38.915992 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.915953 2553 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:39:38.917122 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.917098 2553 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:39:38.917122 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.917121 2553 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:39:38.917281 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.917139 2553 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:39:38.917281 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.917145 2553 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:39:38.917281 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.917188 2553 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:39:38.919645 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.919622 2553 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:39:38.953801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.953719 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:39:38.954786 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.954766 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientMemory" May 21 14:39:38.954872 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.954802 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:39:38.954872 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.954814 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientPID" May 21 14:39:38.954872 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.954839 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-210.ec2.internal" May 21 14:39:38.964767 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:38.964745 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-210.ec2.internal" May 21 14:39:38.964816 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.964772 2553 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-210.ec2.internal\": node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:38.983224 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:38.983196 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.017642 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.017610 2553 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal"] May 21 14:39:39.017730 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.017718 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:39:39.019237 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.019223 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientMemory" May 21 14:39:39.019356 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.019254 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:39:39.019356 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.019270 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientPID" May 21 14:39:39.020631 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.020618 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:39:39.020788 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.020774 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.020825 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.020814 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:39:39.021367 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.021347 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientMemory" May 21 14:39:39.021461 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.021353 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientMemory" May 21 14:39:39.021461 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.021382 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:39:39.021461 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.021395 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientPID" May 21 14:39:39.021461 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.021401 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:39:39.021461 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.021414 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientPID" May 21 14:39:39.022430 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.022412 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" May 21 14:39:39.022509 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.022444 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:39:39.023161 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.023147 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientMemory" May 21 14:39:39.023218 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.023171 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:39:39.023218 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.023181 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeHasSufficientPID" May 21 14:39:39.039209 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.039182 2553 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-210.ec2.internal\" not found" node="ip-10-0-131-210.ec2.internal" May 21 14:39:39.042764 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.042745 2553 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-210.ec2.internal\" not found" node="ip-10-0-131-210.ec2.internal" May 21 14:39:39.083814 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.083777 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.091107 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.091080 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7040529efe10e301ee6c73ca47a35fb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal\" (UID: \"7040529efe10e301ee6c73ca47a35fb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.091167 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.091137 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7040529efe10e301ee6c73ca47a35fb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal\" (UID: \"7040529efe10e301ee6c73ca47a35fb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.091206 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.091175 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93d5251cf7952b6ea18709da9aad2938-config\") pod \"kube-apiserver-proxy-ip-10-0-131-210.ec2.internal\" (UID: \"93d5251cf7952b6ea18709da9aad2938\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" May 21 14:39:39.184920 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.184884 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.192296 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.192266 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7040529efe10e301ee6c73ca47a35fb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal\" (UID: \"7040529efe10e301ee6c73ca47a35fb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.192409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.192304 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7040529efe10e301ee6c73ca47a35fb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal\" (UID: \"7040529efe10e301ee6c73ca47a35fb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.192409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.192320 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93d5251cf7952b6ea18709da9aad2938-config\") pod \"kube-apiserver-proxy-ip-10-0-131-210.ec2.internal\" (UID: \"93d5251cf7952b6ea18709da9aad2938\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" May 21 14:39:39.192409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.192352 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7040529efe10e301ee6c73ca47a35fb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal\" (UID: \"7040529efe10e301ee6c73ca47a35fb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.192409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.192375 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7040529efe10e301ee6c73ca47a35fb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal\" (UID: \"7040529efe10e301ee6c73ca47a35fb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.192409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.192404 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93d5251cf7952b6ea18709da9aad2938-config\") pod \"kube-apiserver-proxy-ip-10-0-131-210.ec2.internal\" (UID: \"93d5251cf7952b6ea18709da9aad2938\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" May 21 14:39:39.285073 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.284974 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.342501 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.342451 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:39.346288 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.346268 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" May 21 14:39:39.385171 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.385139 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.485609 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.485577 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.586167 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.586076 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.686600 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.686563 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.693876 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.693849 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:39:39.694010 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.693995 2553 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:39:39.694054 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.694030 2553 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:39:39.783585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.783537 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:34:38 +0000 UTC" deadline="2027-12-08 22:22:26.135222651 +0000 UTC" May 21 14:39:39.783585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.783589 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13591h42m46.35165167s" May 21 14:39:39.787691 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.787669 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.788758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.788744 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:39:39.804096 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.804071 2553 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:39:39.808942 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.808910 2553 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:39:39.829963 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.829930 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lc9sh" May 21 14:39:39.836799 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.836735 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lc9sh" May 21 14:39:39.888109 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.888076 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:39.894811 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:39.894758 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d5251cf7952b6ea18709da9aad2938.slice/crio-559e15eedb1516ba8ecbad1ec7e93e3a7fceae2561eb73d1dcc7d3d5317f2c1b WatchSource:0}: Error finding container 559e15eedb1516ba8ecbad1ec7e93e3a7fceae2561eb73d1dcc7d3d5317f2c1b: Status 404 returned error can't find the container with id 559e15eedb1516ba8ecbad1ec7e93e3a7fceae2561eb73d1dcc7d3d5317f2c1b May 21 14:39:39.895017 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:39.894996 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7040529efe10e301ee6c73ca47a35fb7.slice/crio-7a77a990f5e55bfdb82ec80b64d5b440ad6112b0eaa642daf2322bb5411db927 WatchSource:0}: Error finding container 7a77a990f5e55bfdb82ec80b64d5b440ad6112b0eaa642daf2322bb5411db927: Status 404 returned error can't find the container with id 7a77a990f5e55bfdb82ec80b64d5b440ad6112b0eaa642daf2322bb5411db927 May 21 14:39:39.898606 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.898592 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:39:39.920276 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.920221 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" event={"ID":"93d5251cf7952b6ea18709da9aad2938","Type":"ContainerStarted","Data":"559e15eedb1516ba8ecbad1ec7e93e3a7fceae2561eb73d1dcc7d3d5317f2c1b"} May 21 14:39:39.921121 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:39.921097 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" event={"ID":"7040529efe10e301ee6c73ca47a35fb7","Type":"ContainerStarted","Data":"7a77a990f5e55bfdb82ec80b64d5b440ad6112b0eaa642daf2322bb5411db927"} May 21 14:39:39.988255 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:39.988218 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:40.088736 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.088655 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:40.189140 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.189109 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:40.289778 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.289743 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-210.ec2.internal\" not found" May 21 14:39:40.333787 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.333754 2553 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:39:40.389130 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.389056 2553 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" May 21 14:39:40.400800 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.400772 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:39:40.401880 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.401866 2553 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" May 21 14:39:40.411759 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.411740 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:39:40.660404 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.660315 2553 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:39:40.765406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.765371 2553 apiserver.go:52] "Watching apiserver" May 21 14:39:40.773136 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.772970 2553 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:39:40.773375 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.773344 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal","openshift-network-diagnostics/network-check-target-7g2ws","openshift-network-operator/iptables-alerter-kn5pf","openshift-ovn-kubernetes/ovnkube-node-ljv64","kube-system/konnectivity-agent-d4l5l","kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt","openshift-dns/node-resolver-7sqdr","openshift-multus/multus-additional-cni-plugins-g7dff","openshift-multus/multus-w2ls9","openshift-multus/network-metrics-daemon-2lsrm","openshift-cluster-node-tuning-operator/tuned-vwm2l","openshift-image-registry/node-ca-j9bjz"] May 21 14:39:40.775162 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.775072 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.776177 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.776154 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.778255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.777699 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:39:40.778255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.777909 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:39:40.778255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.778099 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t9qmm\"" May 21 14:39:40.778255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.778239 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:39:40.778525 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.778456 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:39:40.778584 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.778565 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:39:40.778635 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.778586 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrttr\"" May 21 14:39:40.778930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.778908 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.780208 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.780180 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.781142 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.781018 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tf6rr\"" May 21 14:39:40.781142 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.781018 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:39:40.782565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.781688 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:40.782565 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.781753 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:40.782565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.781813 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.782565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.782125 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:39:40.782565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.782322 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:39:40.782565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.782331 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpcdz\"" May 21 14:39:40.782889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.782621 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:39:40.782889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.782667 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:39:40.784013 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.783993 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.784536 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.784161 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-njbx8\"" May 21 14:39:40.784536 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.784311 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:39:40.784890 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.784872 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:39:40.785316 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.785299 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w2ls9" May 21 14:39:40.786175 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.786157 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b6wl2\"" May 21 14:39:40.786262 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.786236 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:39:40.786590 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.786525 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:39:40.786879 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.786862 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:39:40.786940 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.786923 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:39:40.787143 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.787124 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:39:40.787549 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.787531 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.791044 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.791018 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:39:40.791321 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.791300 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.795124 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.795012 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zcjs5\"" May 21 14:39:40.796801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.795716 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:39:40.796801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.795736 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:39:40.796801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.795853 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:40.796801 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.795937 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:40.796801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.796275 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:39:40.796801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.796526 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:39:40.797221 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797200 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zz9bc\"" May 21 14:39:40.797530 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797515 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:39:40.797851 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797658 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4h4jw\"" May 21 14:39:40.797851 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797714 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:39:40.797851 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797730 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:39:40.797851 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797796 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:39:40.797851 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.797806 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:39:40.800186 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800166 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-netns\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.800270 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800203 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.800270 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9tk8\" (UniqueName: \"kubernetes.io/projected/67f83fc7-915e-4e87-b51c-31a14edd80f9-kube-api-access-j9tk8\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.800270 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800257 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c275336e-90a5-4db0-bd89-976e0a057107-serviceca\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.800421 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-run-netns\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.800421 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800308 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-device-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.800421 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800332 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-kubernetes\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.800421 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800372 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da333afb-a4e4-4356-abd5-02bbcf4c207c-hosts-file\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.800421 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800396 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-kubelet\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800431 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-daemon-config\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800456 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-var-lib-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-socket-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-modprobe-d\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800603 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-cni-bin\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysctl-d\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.800680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800666 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-systemd\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800694 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-host\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800752 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-cnibin\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800776 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-systemd\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800840 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800882 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f20f813c-5ff4-4348-a348-c925153b3900-iptables-alerter-script\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-var-lib-kubelet\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800952 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-system-cni-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.800988 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-k8s-cni-cncf-io\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801010 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-cni-multus\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-etc-kubernetes\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801083 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-systemd-units\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801109 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801153 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-env-overrides\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801176 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f20f813c-5ff4-4348-a348-c925153b3900-host-slash\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801199 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-socket-dir-parent\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-conf-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801252 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801275 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-sys-fs\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801299 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801351 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysconfig\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801392 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj79n\" (UniqueName: \"kubernetes.io/projected/20148859-bfc3-4942-abc0-07f406fab06b-kube-api-access-mj79n\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs59z\" (UniqueName: \"kubernetes.io/projected/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-kube-api-access-qs59z\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:40.801533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801529 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca100150-ad19-437a-a6b9-c630ae06fde3-cni-binary-copy\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.802069 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801562 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-kubelet\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.802355 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.801593 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-ovnkube-script-lib\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.802462 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05787355-21a8-4995-9797-6fdd8d075ee7-konnectivity-ca\") pod \"konnectivity-agent-d4l5l\" (UID: \"05787355-21a8-4995-9797-6fdd8d075ee7\") " pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.802462 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802407 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:40.802580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802483 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2hd\" (UniqueName: \"kubernetes.io/projected/da333afb-a4e4-4356-abd5-02bbcf4c207c-kube-api-access-lp2hd\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.802580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802524 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-system-cni-dir\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.802580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802552 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-cni-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.802580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802575 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-os-release\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802598 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-cni-bin\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802620 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-slash\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802642 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4wvt\" (UniqueName: \"kubernetes.io/projected/459f203d-f079-4b68-b07c-3842c93d8765-kube-api-access-x4wvt\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802664 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-sys\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802686 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da333afb-a4e4-4356-abd5-02bbcf4c207c-tmp-dir\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802716 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.802772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802739 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459f203d-f079-4b68-b07c-3842c93d8765-ovn-node-metrics-cert\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802767 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnx8z\" (UniqueName: \"kubernetes.io/projected/f20f813c-5ff4-4348-a348-c925153b3900-kube-api-access-dnx8z\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802805 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-run\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802829 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-os-release\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802852 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-ovnkube-config\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802876 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05787355-21a8-4995-9797-6fdd8d075ee7-agent-certs\") pod \"konnectivity-agent-d4l5l\" (UID: \"05787355-21a8-4995-9797-6fdd8d075ee7\") " pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802908 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-registration-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802931 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysctl-conf\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20148859-bfc3-4942-abc0-07f406fab06b-tmp\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.802977 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-678d9\" (UniqueName: \"kubernetes.io/projected/ca100150-ad19-437a-a6b9-c630ae06fde3-kube-api-access-678d9\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.803089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803055 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-etc-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803092 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69wfz\" (UniqueName: \"kubernetes.io/projected/c275336e-90a5-4db0-bd89-976e0a057107-kube-api-access-69wfz\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803124 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20148859-bfc3-4942-abc0-07f406fab06b-etc-tuned\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803152 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-hostroot\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803277 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-log-socket\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-ovn\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-node-log\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803420 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-cni-netd\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803448 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c275336e-90a5-4db0-bd89-976e0a057107-host\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-lib-modules\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803520 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803547 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803571 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-multus-certs\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803593 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-cnibin\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.803715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.803618 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb7h9\" (UniqueName: \"kubernetes.io/projected/4a088b46-ed97-484c-b3be-575bef0b2c3e-kube-api-access-pb7h9\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.837677 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.837640 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:34:39 +0000 UTC" deadline="2027-12-20 17:24:03.893713741 +0000 UTC" May 21 14:39:40.837677 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.837671 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13874h44m23.056045982s" May 21 14:39:40.889837 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.889807 2553 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:39:40.904235 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904209 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20148859-bfc3-4942-abc0-07f406fab06b-etc-tuned\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904244 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-hostroot\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904271 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-log-socket\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904291 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-ovn\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904312 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-node-log\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904334 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-cni-netd\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904356 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c275336e-90a5-4db0-bd89-976e0a057107-host\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904377 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-lib-modules\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.904406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904401 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904403 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-ovn\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904413 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-cni-netd\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904426 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904405 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-node-log\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904327 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-hostroot\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904446 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-log-socket\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904472 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-multus-certs\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904525 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-cnibin\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904522 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c275336e-90a5-4db0-bd89-976e0a057107-host\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904562 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb7h9\" (UniqueName: \"kubernetes.io/projected/4a088b46-ed97-484c-b3be-575bef0b2c3e-kube-api-access-pb7h9\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904596 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-netns\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904602 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-cnibin\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904610 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904621 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904641 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-multus-certs\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904730 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-netns\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904735 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.904765 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904720 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9tk8\" (UniqueName: \"kubernetes.io/projected/67f83fc7-915e-4e87-b51c-31a14edd80f9-kube-api-access-j9tk8\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904779 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c275336e-90a5-4db0-bd89-976e0a057107-serviceca\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904811 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-run-netns\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904841 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-lib-modules\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904925 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-device-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904953 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-kubernetes\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.904953 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-run-netns\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905005 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da333afb-a4e4-4356-abd5-02bbcf4c207c-hosts-file\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905033 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905060 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-device-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905037 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-kubernetes\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905103 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.905415 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905288 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c275336e-90a5-4db0-bd89-976e0a057107-serviceca\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905517 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-kubelet\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905541 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da333afb-a4e4-4356-abd5-02bbcf4c207c-hosts-file\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905576 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-daemon-config\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905595 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-var-lib-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905619 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-socket-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905640 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-kubelet\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905680 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-modprobe-d\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905772 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-socket-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905800 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-cni-bin\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.905840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905835 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysctl-d\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905842 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-modprobe-d\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905858 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-systemd\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905887 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-var-lib-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905930 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-host\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905959 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905975 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-host\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.905986 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-cnibin\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906038 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-systemd\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906046 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-cni-bin\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906063 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906103 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906077 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-daemon-config\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906135 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysctl-d\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906160 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f20f813c-5ff4-4348-a348-c925153b3900-iptables-alerter-script\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906176 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.906179 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906182 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-var-lib-kubelet\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906204 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-system-cni-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906211 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-systemd\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906224 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-k8s-cni-cncf-io\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906268 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-run-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906270 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-run-k8s-cni-cncf-io\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906302 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-cnibin\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906305 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-cni-multus\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906333 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-system-cni-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906332 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-etc-kubernetes\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906360 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-systemd-units\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906365 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-etc-kubernetes\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906392 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906403 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906419 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-env-overrides\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906405 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-var-lib-kubelet\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906442 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-systemd\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906445 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f20f813c-5ff4-4348-a348-c925153b3900-host-slash\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.906758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906480 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-cni-multus\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906486 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f20f813c-5ff4-4348-a348-c925153b3900-host-slash\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906550 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-systemd-units\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906585 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906631 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-socket-dir-parent\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906659 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-conf-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906686 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906720 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-sys-fs\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906744 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906765 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysconfig\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906787 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj79n\" (UniqueName: \"kubernetes.io/projected/20148859-bfc3-4942-abc0-07f406fab06b-kube-api-access-mj79n\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906857 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs59z\" (UniqueName: \"kubernetes.io/projected/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-kube-api-access-qs59z\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906882 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca100150-ad19-437a-a6b9-c630ae06fde3-cni-binary-copy\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906883 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f20f813c-5ff4-4348-a348-c925153b3900-iptables-alerter-script\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906906 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-kubelet\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906921 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-env-overrides\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906933 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-ovnkube-script-lib\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907351 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.906943 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-sys-fs\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907071 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05787355-21a8-4995-9797-6fdd8d075ee7-konnectivity-ca\") pod \"konnectivity-agent-d4l5l\" (UID: \"05787355-21a8-4995-9797-6fdd8d075ee7\") " pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907103 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907129 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2hd\" (UniqueName: \"kubernetes.io/projected/da333afb-a4e4-4356-abd5-02bbcf4c207c-kube-api-access-lp2hd\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907163 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-system-cni-dir\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907212 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-system-cni-dir\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.907231 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907260 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-cni-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.907453 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:39:41.407394094 +0000 UTC m=+3.077644185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907468 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-ovnkube-script-lib\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907535 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysconfig\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907561 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-kubelet\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907604 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-socket-dir-parent\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907639 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-conf-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907695 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-multus-cni-dir\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907730 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-os-release\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907748 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-cni-bin\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.907977 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907764 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-slash\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907807 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-host-var-lib-cni-bin\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907826 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca100150-ad19-437a-a6b9-c630ae06fde3-os-release\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907831 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-host-slash\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907847 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4wvt\" (UniqueName: \"kubernetes.io/projected/459f203d-f079-4b68-b07c-3842c93d8765-kube-api-access-x4wvt\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907857 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca100150-ad19-437a-a6b9-c630ae06fde3-cni-binary-copy\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907865 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-sys\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907891 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da333afb-a4e4-4356-abd5-02bbcf4c207c-tmp-dir\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907910 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907937 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459f203d-f079-4b68-b07c-3842c93d8765-ovn-node-metrics-cert\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907954 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnx8z\" (UniqueName: \"kubernetes.io/projected/f20f813c-5ff4-4348-a348-c925153b3900-kube-api-access-dnx8z\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907971 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-run\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.907987 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-os-release\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908004 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-ovnkube-config\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908051 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05787355-21a8-4995-9797-6fdd8d075ee7-agent-certs\") pod \"konnectivity-agent-d4l5l\" (UID: \"05787355-21a8-4995-9797-6fdd8d075ee7\") " pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908069 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-registration-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908106 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysctl-conf\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.908638 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908131 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20148859-bfc3-4942-abc0-07f406fab06b-tmp\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908152 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908157 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-678d9\" (UniqueName: \"kubernetes.io/projected/ca100150-ad19-437a-a6b9-c630ae06fde3-kube-api-access-678d9\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908191 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05787355-21a8-4995-9797-6fdd8d075ee7-konnectivity-ca\") pod \"konnectivity-agent-d4l5l\" (UID: \"05787355-21a8-4995-9797-6fdd8d075ee7\") " pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908203 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-etc-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908238 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-run\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908239 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69wfz\" (UniqueName: \"kubernetes.io/projected/c275336e-90a5-4db0-bd89-976e0a057107-kube-api-access-69wfz\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908320 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a088b46-ed97-484c-b3be-575bef0b2c3e-os-release\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908375 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67f83fc7-915e-4e87-b51c-31a14edd80f9-registration-dir\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908486 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-etc-sysctl-conf\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908672 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459f203d-f079-4b68-b07c-3842c93d8765-ovnkube-config\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908681 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459f203d-f079-4b68-b07c-3842c93d8765-etc-openvswitch\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.908938 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20148859-bfc3-4942-abc0-07f406fab06b-sys\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.909199 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da333afb-a4e4-4356-abd5-02bbcf4c207c-tmp-dir\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.909258 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a088b46-ed97-484c-b3be-575bef0b2c3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.909912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.909446 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20148859-bfc3-4942-abc0-07f406fab06b-etc-tuned\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.910929 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.910835 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20148859-bfc3-4942-abc0-07f406fab06b-tmp\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.910929 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.910855 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459f203d-f079-4b68-b07c-3842c93d8765-ovn-node-metrics-cert\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.911317 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.911300 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05787355-21a8-4995-9797-6fdd8d075ee7-agent-certs\") pod \"konnectivity-agent-d4l5l\" (UID: \"05787355-21a8-4995-9797-6fdd8d075ee7\") " pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:40.927829 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.927773 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:39:40.927829 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.927802 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:39:40.928095 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.928073 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:40.928268 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:40.928169 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:41.428144238 +0000 UTC m=+3.098394328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:40.931184 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.931155 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs59z\" (UniqueName: \"kubernetes.io/projected/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-kube-api-access-qs59z\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:40.931322 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.931300 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnx8z\" (UniqueName: \"kubernetes.io/projected/f20f813c-5ff4-4348-a348-c925153b3900-kube-api-access-dnx8z\") pod \"iptables-alerter-kn5pf\" (UID: \"f20f813c-5ff4-4348-a348-c925153b3900\") " pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:40.931439 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.931397 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj79n\" (UniqueName: \"kubernetes.io/projected/20148859-bfc3-4942-abc0-07f406fab06b-kube-api-access-mj79n\") pod \"tuned-vwm2l\" (UID: \"20148859-bfc3-4942-abc0-07f406fab06b\") " pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:40.931874 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.931831 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb7h9\" (UniqueName: \"kubernetes.io/projected/4a088b46-ed97-484c-b3be-575bef0b2c3e-kube-api-access-pb7h9\") pod \"multus-additional-cni-plugins-g7dff\" (UID: \"4a088b46-ed97-484c-b3be-575bef0b2c3e\") " pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:40.932704 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.932682 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4wvt\" (UniqueName: \"kubernetes.io/projected/459f203d-f079-4b68-b07c-3842c93d8765-kube-api-access-x4wvt\") pod \"ovnkube-node-ljv64\" (UID: \"459f203d-f079-4b68-b07c-3842c93d8765\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:40.933156 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.933138 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2hd\" (UniqueName: \"kubernetes.io/projected/da333afb-a4e4-4356-abd5-02bbcf4c207c-kube-api-access-lp2hd\") pod \"node-resolver-7sqdr\" (UID: \"da333afb-a4e4-4356-abd5-02bbcf4c207c\") " pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:40.933279 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.933259 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69wfz\" (UniqueName: \"kubernetes.io/projected/c275336e-90a5-4db0-bd89-976e0a057107-kube-api-access-69wfz\") pod \"node-ca-j9bjz\" (UID: \"c275336e-90a5-4db0-bd89-976e0a057107\") " pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:40.933436 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.933420 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-678d9\" (UniqueName: \"kubernetes.io/projected/ca100150-ad19-437a-a6b9-c630ae06fde3-kube-api-access-678d9\") pod \"multus-w2ls9\" (UID: \"ca100150-ad19-437a-a6b9-c630ae06fde3\") " pod="openshift-multus/multus-w2ls9" May 21 14:39:40.934403 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.934384 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9tk8\" (UniqueName: \"kubernetes.io/projected/67f83fc7-915e-4e87-b51c-31a14edd80f9-kube-api-access-j9tk8\") pod \"aws-ebs-csi-driver-node-f98tt\" (UID: \"67f83fc7-915e-4e87-b51c-31a14edd80f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:40.971286 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:40.971253 2553 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:39:41.093834 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.093794 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d4l5l" May 21 14:39:41.104607 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.104585 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j9bjz" May 21 14:39:41.114396 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.114364 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" May 21 14:39:41.121215 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.121184 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" May 21 14:39:41.129905 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.129884 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7sqdr" May 21 14:39:41.138568 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.138538 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g7dff" May 21 14:39:41.144234 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.144214 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w2ls9" May 21 14:39:41.152940 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.152922 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:39:41.161613 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.161555 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kn5pf" May 21 14:39:41.411855 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.411770 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:41.411998 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.411890 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:41.411998 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.411947 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:39:42.41193216 +0000 UTC m=+4.082182232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:41.434631 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.434595 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mmt24"] May 21 14:39:41.436731 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.436699 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.436870 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.436788 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:41.512409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.512379 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-dbus\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.512619 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.512425 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.512619 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.512476 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:41.512619 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.512548 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-kubelet-config\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.512757 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.512685 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:39:41.512757 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.512709 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:39:41.512757 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.512719 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:41.512873 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.512790 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:42.512768615 +0000 UTC m=+4.183018691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:41.598790 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.598758 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc275336e_90a5_4db0_bd89_976e0a057107.slice/crio-d54b808900563daa5266856b20bc2e9f959a508fcb2d8bfde8560b657a35826b WatchSource:0}: Error finding container d54b808900563daa5266856b20bc2e9f959a508fcb2d8bfde8560b657a35826b: Status 404 returned error can't find the container with id d54b808900563daa5266856b20bc2e9f959a508fcb2d8bfde8560b657a35826b May 21 14:39:41.599550 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.599525 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda333afb_a4e4_4356_abd5_02bbcf4c207c.slice/crio-d6b901c311654e7b4a5e451925b8a07c4dbc1c35d1b5619ed84538b1fd308e2a WatchSource:0}: Error finding container d6b901c311654e7b4a5e451925b8a07c4dbc1c35d1b5619ed84538b1fd308e2a: Status 404 returned error can't find the container with id d6b901c311654e7b4a5e451925b8a07c4dbc1c35d1b5619ed84538b1fd308e2a May 21 14:39:41.600581 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.600444 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20148859_bfc3_4942_abc0_07f406fab06b.slice/crio-1a36dc59bffa79c7ca0328c340212cc49cde430afb8aba1dfb7d72334e8d4f74 WatchSource:0}: Error finding container 1a36dc59bffa79c7ca0328c340212cc49cde430afb8aba1dfb7d72334e8d4f74: Status 404 returned error can't find the container with id 1a36dc59bffa79c7ca0328c340212cc49cde430afb8aba1dfb7d72334e8d4f74 May 21 14:39:41.605063 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.601871 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f83fc7_915e_4e87_b51c_31a14edd80f9.slice/crio-fcc8719eda911e3786d69d3b2d15b8e52d8484f5bed165e3d39ef9fd6100fde8 WatchSource:0}: Error finding container fcc8719eda911e3786d69d3b2d15b8e52d8484f5bed165e3d39ef9fd6100fde8: Status 404 returned error can't find the container with id fcc8719eda911e3786d69d3b2d15b8e52d8484f5bed165e3d39ef9fd6100fde8 May 21 14:39:41.606235 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.606213 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05787355_21a8_4995_9797_6fdd8d075ee7.slice/crio-40dddfa00637cc6647468d41d230ea0b70948fa0c402ba41114fe441080beafc WatchSource:0}: Error finding container 40dddfa00637cc6647468d41d230ea0b70948fa0c402ba41114fe441080beafc: Status 404 returned error can't find the container with id 40dddfa00637cc6647468d41d230ea0b70948fa0c402ba41114fe441080beafc May 21 14:39:41.606967 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.606944 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod459f203d_f079_4b68_b07c_3842c93d8765.slice/crio-81104c78d029db82a8dcfa3d6648432f608712296de01469bb090fe2042fa6bd WatchSource:0}: Error finding container 81104c78d029db82a8dcfa3d6648432f608712296de01469bb090fe2042fa6bd: Status 404 returned error can't find the container with id 81104c78d029db82a8dcfa3d6648432f608712296de01469bb090fe2042fa6bd May 21 14:39:41.608366 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.608143 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca100150_ad19_437a_a6b9_c630ae06fde3.slice/crio-c276d752db10708e64d4684b1365b66d91959fab0fdd96d8dc9fb551137934b6 WatchSource:0}: Error finding container c276d752db10708e64d4684b1365b66d91959fab0fdd96d8dc9fb551137934b6: Status 404 returned error can't find the container with id c276d752db10708e64d4684b1365b66d91959fab0fdd96d8dc9fb551137934b6 May 21 14:39:41.609998 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:39:41.608764 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20f813c_5ff4_4348_a348_c925153b3900.slice/crio-9217214cd1bc7831db81e328576257645ad82bc5f0a1955c55ac97210eabc084 WatchSource:0}: Error finding container 9217214cd1bc7831db81e328576257645ad82bc5f0a1955c55ac97210eabc084: Status 404 returned error can't find the container with id 9217214cd1bc7831db81e328576257645ad82bc5f0a1955c55ac97210eabc084 May 21 14:39:41.612809 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.612788 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-dbus\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.612870 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.612824 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.612934 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.612921 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-kubelet-config\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.612976 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.612921 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-dbus\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.612976 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.612965 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:39:41.613058 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.613006 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-kubelet-config\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:41.613058 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.613010 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:39:42.112996223 +0000 UTC m=+3.783246316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:39:41.839030 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.838777 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:34:39 +0000 UTC" deadline="2028-02-19 03:39:37.45501438 +0000 UTC" May 21 14:39:41.839030 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.839029 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15324h59m55.615990272s" May 21 14:39:41.917474 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.917450 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:41.917629 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:41.917575 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:41.928404 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.928293 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" event={"ID":"93d5251cf7952b6ea18709da9aad2938","Type":"ContainerStarted","Data":"741bcac83ba15b4e032ddfe6a3098921bebfeaa32bfc965aa902bf8e2b8accfd"} May 21 14:39:41.929549 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.929523 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d4l5l" event={"ID":"05787355-21a8-4995-9797-6fdd8d075ee7","Type":"ContainerStarted","Data":"40dddfa00637cc6647468d41d230ea0b70948fa0c402ba41114fe441080beafc"} May 21 14:39:41.930816 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.930785 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" event={"ID":"67f83fc7-915e-4e87-b51c-31a14edd80f9","Type":"ContainerStarted","Data":"fcc8719eda911e3786d69d3b2d15b8e52d8484f5bed165e3d39ef9fd6100fde8"} May 21 14:39:41.932125 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.932078 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j9bjz" event={"ID":"c275336e-90a5-4db0-bd89-976e0a057107","Type":"ContainerStarted","Data":"d54b808900563daa5266856b20bc2e9f959a508fcb2d8bfde8560b657a35826b"} May 21 14:39:41.933855 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.933816 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" event={"ID":"7040529efe10e301ee6c73ca47a35fb7","Type":"ContainerStarted","Data":"e8c47556a15a01c76ba71370ce1f59f69b6c8e478ed955dc998cd7676e37a0bc"} May 21 14:39:41.935306 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.935272 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerStarted","Data":"c90de1ffc905509277844621b440feb1ccd05c1ea948f076f455058e0beef791"} May 21 14:39:41.936673 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.936650 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w2ls9" event={"ID":"ca100150-ad19-437a-a6b9-c630ae06fde3","Type":"ContainerStarted","Data":"c276d752db10708e64d4684b1365b66d91959fab0fdd96d8dc9fb551137934b6"} May 21 14:39:41.938166 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.938130 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kn5pf" event={"ID":"f20f813c-5ff4-4348-a348-c925153b3900","Type":"ContainerStarted","Data":"9217214cd1bc7831db81e328576257645ad82bc5f0a1955c55ac97210eabc084"} May 21 14:39:41.939660 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.939623 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"81104c78d029db82a8dcfa3d6648432f608712296de01469bb090fe2042fa6bd"} May 21 14:39:41.940966 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.940942 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7sqdr" event={"ID":"da333afb-a4e4-4356-abd5-02bbcf4c207c","Type":"ContainerStarted","Data":"d6b901c311654e7b4a5e451925b8a07c4dbc1c35d1b5619ed84538b1fd308e2a"} May 21 14:39:41.942210 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.942182 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" event={"ID":"20148859-bfc3-4942-abc0-07f406fab06b","Type":"ContainerStarted","Data":"1a36dc59bffa79c7ca0328c340212cc49cde430afb8aba1dfb7d72334e8d4f74"} May 21 14:39:41.943470 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:41.943430 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-210.ec2.internal" podStartSLOduration=1.943420035 podStartE2EDuration="1.943420035s" podCreationTimestamp="2026-05-21 14:39:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:39:41.943113815 +0000 UTC m=+3.613363910" watchObservedRunningTime="2026-05-21 14:39:41.943420035 +0000 UTC m=+3.613670139" May 21 14:39:42.119740 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.119692 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:42.119935 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.119914 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:39:42.119994 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.119979 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:39:43.119961844 +0000 UTC m=+4.790211932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:39:42.422368 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.422281 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:42.422549 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.422446 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:42.422549 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.422527 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:39:44.422507066 +0000 UTC m=+6.092757160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:42.523296 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.523256 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:42.523466 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.523449 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:39:42.523577 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.523469 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:39:42.523577 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.523483 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:42.523577 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.523563 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:44.52354418 +0000 UTC m=+6.193794255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:42.920706 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.920606 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:42.921134 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.920730 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:42.921203 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.921142 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:42.921265 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:42.921240 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:42.958898 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.958857 2553 generic.go:358] "Generic (PLEG): container finished" podID="7040529efe10e301ee6c73ca47a35fb7" containerID="e8c47556a15a01c76ba71370ce1f59f69b6c8e478ed955dc998cd7676e37a0bc" exitCode=0 May 21 14:39:42.959067 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:42.958934 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" event={"ID":"7040529efe10e301ee6c73ca47a35fb7","Type":"ContainerDied","Data":"e8c47556a15a01c76ba71370ce1f59f69b6c8e478ed955dc998cd7676e37a0bc"} May 21 14:39:43.128953 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:43.128214 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:43.128953 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:43.128394 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:39:43.128953 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:43.128468 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:39:45.128448788 +0000 UTC m=+6.798698872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:39:43.917993 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:43.917955 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:43.918186 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:43.918099 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:43.974570 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:43.974255 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" event={"ID":"7040529efe10e301ee6c73ca47a35fb7","Type":"ContainerStarted","Data":"bd41c9669333ec63e7385286c63fb3fa8291421f1dad6a5ba22a83a7151e7eec"} May 21 14:39:44.439042 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:44.439011 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:44.439209 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.439194 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:44.439274 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.439264 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:39:48.439243143 +0000 UTC m=+10.109493222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:44.540276 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:44.540238 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:44.540451 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.540437 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:39:44.540551 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.540455 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:39:44.540551 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.540468 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:44.540551 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.540543 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:48.540523844 +0000 UTC m=+10.210773927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:44.918199 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:44.917661 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:44.918199 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.917789 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:44.918424 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:44.918228 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:44.918424 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:44.918338 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:45.148393 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:45.148355 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:45.148883 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:45.148527 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:39:45.148883 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:45.148587 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:39:49.14857177 +0000 UTC m=+10.818821842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:39:45.918573 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:45.918036 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:45.918573 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:45.918186 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:46.917980 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:46.917445 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:46.917980 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:46.917597 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:46.918481 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:46.918093 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:46.918481 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:46.918194 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:47.918135 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:47.918094 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:47.918614 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:47.918248 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:48.476366 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:48.475760 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:48.476366 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.475969 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:48.476366 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.476037 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:39:56.47601643 +0000 UTC m=+18.146266508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:48.576716 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:48.576677 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:48.576920 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.576898 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:39:48.577015 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.576925 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:39:48.577015 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.576939 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:48.577015 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.577007 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:56.576984278 +0000 UTC m=+18.247234351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:48.918822 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:48.918723 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:48.919272 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.918832 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:48.919272 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:48.919254 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:48.919385 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:48.919346 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:49.182000 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:49.181902 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:49.182150 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:49.182037 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:39:49.182150 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:49.182101 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:39:57.182082972 +0000 UTC m=+18.852333045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:39:49.917911 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:49.917825 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:49.918068 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:49.917974 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:50.917712 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:50.917675 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:50.918177 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:50.917810 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:50.918177 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:50.917861 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:50.918177 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:50.917941 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:51.917786 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:51.917748 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:51.918166 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:51.917860 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:52.917338 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:52.917308 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:52.917546 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:52.917358 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:52.917546 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:52.917451 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:52.917649 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:52.917580 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:53.918405 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:53.918363 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:53.918878 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:53.918506 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:54.918411 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:54.918371 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:54.918894 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:54.918413 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:54.918894 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:54.918547 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:54.918894 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:54.918649 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:55.918215 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:55.918170 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:55.918536 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:55.918306 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:56.538947 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:56.538910 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:56.539122 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.539048 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:56.539122 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.539110 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:40:12.53909162 +0000 UTC m=+34.209341719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:39:56.640334 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:56.640298 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:56.640505 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.640433 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:39:56.640505 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.640451 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:39:56.640505 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.640463 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:56.640616 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.640539 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:12.640520145 +0000 UTC m=+34.310770230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:39:56.918352 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:56.918268 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:56.918547 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.918404 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:56.918547 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:56.918463 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:56.918975 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:56.918592 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:57.243838 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:57.243739 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:57.243995 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:57.243919 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:39:57.244063 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:57.243999 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:40:13.243979663 +0000 UTC m=+34.914229739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:39:57.917709 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:57.917669 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:57.917878 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:57.917807 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:39:58.918648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:58.918606 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:39:58.919114 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:58.918690 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:39:58.919114 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:58.918709 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:39:58.919114 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:58.918777 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:39:59.917777 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:39:59.917740 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:39:59.918015 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:39:59.917853 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:00.918037 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:00.917611 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:00.918864 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:00.917696 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:00.918864 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:00.918144 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:00.918864 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:00.918231 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:01.004677 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.004636 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d4l5l" event={"ID":"05787355-21a8-4995-9797-6fdd8d075ee7","Type":"ContainerStarted","Data":"731e91e1ff31cace29548ddc2f751d93bff730c7970981ec2ff2d171f7bbad7c"} May 21 14:40:01.006717 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.006686 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" event={"ID":"67f83fc7-915e-4e87-b51c-31a14edd80f9","Type":"ContainerStarted","Data":"f106c75b9e3768d3036bdeda13e4f85c8925676da3fba78cafde85cec18efe99"} May 21 14:40:01.008228 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.008199 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j9bjz" event={"ID":"c275336e-90a5-4db0-bd89-976e0a057107","Type":"ContainerStarted","Data":"be46c1a670fed617e1b1e4289f1a7be3929d2b728a3bcdda695e9e36d15d7e0c"} May 21 14:40:01.009671 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.009643 2553 generic.go:358] "Generic (PLEG): container finished" podID="4a088b46-ed97-484c-b3be-575bef0b2c3e" containerID="64121c983fd057084000a097241bcf78f707316d67dd732c14d962263879bbef" exitCode=0 May 21 14:40:01.010124 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.010085 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerDied","Data":"64121c983fd057084000a097241bcf78f707316d67dd732c14d962263879bbef"} May 21 14:40:01.011639 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.011611 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w2ls9" event={"ID":"ca100150-ad19-437a-a6b9-c630ae06fde3","Type":"ContainerStarted","Data":"0c8c2ded3ce119b23e8f3e9dd355e352b8a0fc7021609b1da9669e3675881929"} May 21 14:40:01.014757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.014701 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"374d4d09260f16a2645fb98ff0b9a2332b13e062d766be877727e8aec750a025"} May 21 14:40:01.014757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.014734 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"93824c07db2cb2e2319805c93234fa5b803980b4ee692e7f81d1f9cffc8c10ef"} May 21 14:40:01.014757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.014750 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"d3fdd69427bbdafc8b184c15d0425b6a74602de7e0a4f14fdc492ba11155ee98"} May 21 14:40:01.014960 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.014765 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"e0397c7078ec48a227869a058738f39cf8f78fe3ab76bf8e9870503ae914c6e0"} May 21 14:40:01.016213 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.016187 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7sqdr" event={"ID":"da333afb-a4e4-4356-abd5-02bbcf4c207c","Type":"ContainerStarted","Data":"c51e9d1f3cb1271033c53ad5474c0c05071435803420de798af420dfdebc7918"} May 21 14:40:01.017654 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.017629 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" event={"ID":"20148859-bfc3-4942-abc0-07f406fab06b","Type":"ContainerStarted","Data":"54e2202bbbe940530e070f2d51e8cd85932fccd848bedd8a57af635582c097ae"} May 21 14:40:01.029828 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.029767 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-210.ec2.internal" podStartSLOduration=21.029749564 podStartE2EDuration="21.029749564s" podCreationTimestamp="2026-05-21 14:39:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:39:43.988610901 +0000 UTC m=+5.658860998" watchObservedRunningTime="2026-05-21 14:40:01.029749564 +0000 UTC m=+22.699999661" May 21 14:40:01.030231 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.030197 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d4l5l" podStartSLOduration=4.460289108 podStartE2EDuration="23.030188022s" podCreationTimestamp="2026-05-21 14:39:38 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.607743403 +0000 UTC m=+3.277993477" lastFinishedPulling="2026-05-21 14:40:00.177642304 +0000 UTC m=+21.847892391" observedRunningTime="2026-05-21 14:40:01.029915825 +0000 UTC m=+22.700165910" watchObservedRunningTime="2026-05-21 14:40:01.030188022 +0000 UTC m=+22.700438118" May 21 14:40:01.047586 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.047530 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j9bjz" podStartSLOduration=12.517423825 podStartE2EDuration="23.047513249s" podCreationTimestamp="2026-05-21 14:39:38 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.600802149 +0000 UTC m=+3.271052237" lastFinishedPulling="2026-05-21 14:39:52.130891584 +0000 UTC m=+13.801141661" observedRunningTime="2026-05-21 14:40:01.047035966 +0000 UTC m=+22.717286062" watchObservedRunningTime="2026-05-21 14:40:01.047513249 +0000 UTC m=+22.717763340" May 21 14:40:01.068143 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.068093 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vwm2l" podStartSLOduration=4.491475405 podStartE2EDuration="23.068077153s" podCreationTimestamp="2026-05-21 14:39:38 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.602736692 +0000 UTC m=+3.272986766" lastFinishedPulling="2026-05-21 14:40:00.179338431 +0000 UTC m=+21.849588514" observedRunningTime="2026-05-21 14:40:01.067463331 +0000 UTC m=+22.737713427" watchObservedRunningTime="2026-05-21 14:40:01.068077153 +0000 UTC m=+22.738327297" May 21 14:40:01.147606 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.147567 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7sqdr" podStartSLOduration=3.571847222 podStartE2EDuration="22.147551761s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.601772123 +0000 UTC m=+3.272022197" lastFinishedPulling="2026-05-21 14:40:00.177476649 +0000 UTC m=+21.847726736" observedRunningTime="2026-05-21 14:40:01.103620048 +0000 UTC m=+22.773870143" watchObservedRunningTime="2026-05-21 14:40:01.147551761 +0000 UTC m=+22.817801855" May 21 14:40:01.524279 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.524254 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:40:01.866676 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.866514 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:40:01.524273925Z","UUID":"13d5edec-1ec4-4eba-b191-0cda9e48de60","Handler":null,"Name":"","Endpoint":""} May 21 14:40:01.868222 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.868201 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:40:01.868341 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.868231 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:40:01.917769 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:01.917743 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:01.917945 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:01.917853 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:02.022041 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.021992 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" event={"ID":"67f83fc7-915e-4e87-b51c-31a14edd80f9","Type":"ContainerStarted","Data":"1a4538b167ebb328a26b5446bb3b5b40b678bb72ffebb7717f45d1b76f9ada3d"} May 21 14:40:02.023830 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.023725 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kn5pf" event={"ID":"f20f813c-5ff4-4348-a348-c925153b3900","Type":"ContainerStarted","Data":"1ac2a9885a780740e18be71a6246c74e46b0c093d98af447550dd0ea76937fb6"} May 21 14:40:02.026991 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.026949 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"f90011996e60220b32346181e54b05f3a356624d1125256053e62915a64cc397"} May 21 14:40:02.026991 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.026991 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"0bba48f209598ca81335905605f09de81b5912b97ba4bb741c94940f8b437222"} May 21 14:40:02.044867 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.044810 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-w2ls9" podStartSLOduration=4.446980682 podStartE2EDuration="23.044778246s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.610114963 +0000 UTC m=+3.280365051" lastFinishedPulling="2026-05-21 14:40:00.207912532 +0000 UTC m=+21.878162615" observedRunningTime="2026-05-21 14:40:01.171020144 +0000 UTC m=+22.841270239" watchObservedRunningTime="2026-05-21 14:40:02.044778246 +0000 UTC m=+23.715028341" May 21 14:40:02.735361 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.735317 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d4l5l" May 21 14:40:02.736057 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.736036 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d4l5l" May 21 14:40:02.758950 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.758897 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kn5pf" podStartSLOduration=5.192748708 podStartE2EDuration="23.758881384s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.611344993 +0000 UTC m=+3.281595081" lastFinishedPulling="2026-05-21 14:40:00.177477667 +0000 UTC m=+21.847727757" observedRunningTime="2026-05-21 14:40:02.044565978 +0000 UTC m=+23.714816072" watchObservedRunningTime="2026-05-21 14:40:02.758881384 +0000 UTC m=+24.429131480" May 21 14:40:02.921123 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.921047 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:02.921123 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:02.921067 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:02.921332 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:02.921165 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:02.921332 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:02.921288 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:03.031011 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:03.030972 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" event={"ID":"67f83fc7-915e-4e87-b51c-31a14edd80f9","Type":"ContainerStarted","Data":"240e937075066aa613bb9d5a2e0a0c87fdd1a20bdc45f9a6a38e9b74ea0375a3"} May 21 14:40:03.031443 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:03.031359 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d4l5l" May 21 14:40:03.031731 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:03.031710 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d4l5l" May 21 14:40:03.057680 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:03.057628 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f98tt" podStartSLOduration=3.08292649 podStartE2EDuration="24.057615459s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.603864098 +0000 UTC m=+3.274114170" lastFinishedPulling="2026-05-21 14:40:02.578553061 +0000 UTC m=+24.248803139" observedRunningTime="2026-05-21 14:40:03.057588853 +0000 UTC m=+24.727838948" watchObservedRunningTime="2026-05-21 14:40:03.057615459 +0000 UTC m=+24.727865536" May 21 14:40:03.917807 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:03.917771 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:03.917957 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:03.917921 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:04.036566 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:04.036527 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"c63fb47969f494d08e14a700cf5a09e759137073c3783198e3d74b30aae31af0"} May 21 14:40:04.921440 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:04.921243 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:04.921619 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:04.921251 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:04.921619 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:04.921550 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:04.921619 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:04.921594 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:05.918177 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:05.918137 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:05.918852 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:05.918251 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:06.041994 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.041803 2553 generic.go:358] "Generic (PLEG): container finished" podID="4a088b46-ed97-484c-b3be-575bef0b2c3e" containerID="43cb3fe93bf235f6dc6c0266199227db70bad92039cc01830948200e91a0a601" exitCode=0 May 21 14:40:06.042149 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.041890 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerDied","Data":"43cb3fe93bf235f6dc6c0266199227db70bad92039cc01830948200e91a0a601"} May 21 14:40:06.045175 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.045144 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" event={"ID":"459f203d-f079-4b68-b07c-3842c93d8765","Type":"ContainerStarted","Data":"9d8a6648647563d4711823af6b335d4aec388c7c100655c08dbe0b43f82665ec"} May 21 14:40:06.045429 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.045396 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:40:06.045666 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.045434 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:40:06.061924 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.061896 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:40:06.062073 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.061972 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:40:06.103971 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.103916 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" podStartSLOduration=8.221097393 podStartE2EDuration="27.103903091s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.609029091 +0000 UTC m=+3.279279169" lastFinishedPulling="2026-05-21 14:40:00.491834774 +0000 UTC m=+22.162084867" observedRunningTime="2026-05-21 14:40:06.103798153 +0000 UTC m=+27.774048248" watchObservedRunningTime="2026-05-21 14:40:06.103903091 +0000 UTC m=+27.774153186" May 21 14:40:06.917356 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.917324 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:06.917458 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:06.917354 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:06.917508 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:06.917470 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:06.917608 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:06.917585 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:07.049175 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.049142 2553 generic.go:358] "Generic (PLEG): container finished" podID="4a088b46-ed97-484c-b3be-575bef0b2c3e" containerID="15b7e3fa2f1f57004b27aa58cf0f66efe33ea026254e5b5e5889a4a8823b908b" exitCode=0 May 21 14:40:07.049568 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.049224 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerDied","Data":"15b7e3fa2f1f57004b27aa58cf0f66efe33ea026254e5b5e5889a4a8823b908b"} May 21 14:40:07.049618 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.049564 2553 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 14:40:07.472210 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.472165 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lsrm"] May 21 14:40:07.472367 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.472311 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:07.472450 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:07.472431 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:07.475817 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.475786 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mmt24"] May 21 14:40:07.476082 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.476066 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:07.476291 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:07.476259 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:07.476525 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.476479 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7g2ws"] May 21 14:40:07.476615 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:07.476597 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:07.476714 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:07.476691 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:08.053016 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:08.052985 2553 generic.go:358] "Generic (PLEG): container finished" podID="4a088b46-ed97-484c-b3be-575bef0b2c3e" containerID="c3ae3f419c9a261a66f2c77f3437d8b4731a6025e407c8435fbc51f374f43e89" exitCode=0 May 21 14:40:08.053446 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:08.053073 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerDied","Data":"c3ae3f419c9a261a66f2c77f3437d8b4731a6025e407c8435fbc51f374f43e89"} May 21 14:40:08.053446 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:08.053284 2553 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 14:40:08.921278 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:08.921056 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:08.921457 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:08.921056 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:08.921457 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:08.921385 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:08.921457 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:08.921086 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:08.921457 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:08.921448 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:08.921671 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:08.921529 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:10.920950 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.920909 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:10.921561 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.920909 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:10.921561 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:10.921043 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:10.921561 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.920909 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:10.921561 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:10.921100 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:10.921561 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:10.921175 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:10.957033 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.956997 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:40:10.957306 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.957289 2553 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 14:40:10.970805 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.970764 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" podUID="459f203d-f079-4b68-b07c-3842c93d8765" containerName="ovnkube-controller" probeResult="failure" output="" May 21 14:40:10.980580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:10.980539 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" podUID="459f203d-f079-4b68-b07c-3842c93d8765" containerName="ovnkube-controller" probeResult="failure" output="" May 21 14:40:12.563281 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:12.563244 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:12.563785 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.563400 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:40:12.563785 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.563462 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:40:44.563444027 +0000 UTC m=+66.233694105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:40:12.664268 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:12.664227 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:12.664435 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.664417 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:40:12.664481 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.664444 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:40:12.664481 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.664458 2553 projected.go:194] Error preparing data for projected volume kube-api-access-xncqz for pod openshift-network-diagnostics/network-check-target-7g2ws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:40:12.664579 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.664569 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz podName:ebb38515-240a-4f84-94f8-f8d541868811 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:44.664544425 +0000 UTC m=+66.334794507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xncqz" (UniqueName: "kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz") pod "network-check-target-7g2ws" (UID: "ebb38515-240a-4f84-94f8-f8d541868811") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:40:12.917735 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:12.917655 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:12.917902 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:12.917655 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:12.917902 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.917787 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mmt24" podUID="dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b" May 21 14:40:12.917902 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:12.917667 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:12.917902 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.917867 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g2ws" podUID="ebb38515-240a-4f84-94f8-f8d541868811" May 21 14:40:12.918048 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:12.917987 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:40:13.132873 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.132844 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-210.ec2.internal" event="NodeReady" May 21 14:40:13.133035 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.132991 2553 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:40:13.181398 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.181295 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7qrnt"] May 21 14:40:13.214993 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.214962 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fmq5c"] May 21 14:40:13.215247 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.215227 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.217864 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.217839 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:40:13.217991 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.217849 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:40:13.217991 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.217850 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjhqp\"" May 21 14:40:13.231037 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.231014 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7qrnt"] May 21 14:40:13.231129 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.231047 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmq5c"] May 21 14:40:13.231193 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.231162 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.234451 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.234269 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:40:13.234580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.234485 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:40:13.234875 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.234852 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fl969\"" May 21 14:40:13.235628 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.235610 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:40:13.269747 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.269706 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:13.269897 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.269856 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:40:13.269946 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.269918 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret podName:dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b nodeName:}" failed. No retries permitted until 2026-05-21 14:40:45.269903434 +0000 UTC m=+66.940153511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret") pod "global-pull-secret-syncer-mmt24" (UID: "dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b") : object "kube-system"/"original-pull-secret" not registered May 21 14:40:13.371191 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.371155 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g2qd\" (UniqueName: \"kubernetes.io/projected/b2ddd360-2983-47bf-89d1-2164226fcc32-kube-api-access-5g2qd\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.371191 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.371199 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ddd360-2983-47bf-89d1-2164226fcc32-tmp-dir\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.371438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.371230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.371438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.371269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ddd360-2983-47bf-89d1-2164226fcc32-config-volume\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.371438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.371297 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.371438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.371319 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdrh\" (UniqueName: \"kubernetes.io/projected/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-kube-api-access-2cdrh\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.472178 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472077 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5g2qd\" (UniqueName: \"kubernetes.io/projected/b2ddd360-2983-47bf-89d1-2164226fcc32-kube-api-access-5g2qd\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.472178 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472123 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ddd360-2983-47bf-89d1-2164226fcc32-tmp-dir\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.472396 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472241 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.472396 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472277 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ddd360-2983-47bf-89d1-2164226fcc32-config-volume\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.472396 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.472370 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:13.472565 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.472434 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:13.972413082 +0000 UTC m=+35.642663154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:13.472565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472478 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ddd360-2983-47bf-89d1-2164226fcc32-tmp-dir\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.472565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472479 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.472565 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472563 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdrh\" (UniqueName: \"kubernetes.io/projected/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-kube-api-access-2cdrh\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.472761 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.472585 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:13.472761 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.472711 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:13.972690519 +0000 UTC m=+35.642940605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:13.472869 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.472804 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ddd360-2983-47bf-89d1-2164226fcc32-config-volume\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.484089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.484056 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g2qd\" (UniqueName: \"kubernetes.io/projected/b2ddd360-2983-47bf-89d1-2164226fcc32-kube-api-access-5g2qd\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.484231 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.484145 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdrh\" (UniqueName: \"kubernetes.io/projected/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-kube-api-access-2cdrh\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.976907 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.976860 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:13.977614 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:13.976926 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:13.977614 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.977029 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:13.977614 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.977089 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:13.977614 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.977125 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:14.977102594 +0000 UTC m=+36.647352681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:13.977614 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:13.977161 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:14.977144192 +0000 UTC m=+36.647394267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:14.917611 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.917568 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:14.917611 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.917611 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:14.917862 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.917671 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:14.921260 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.921235 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:40:14.921260 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.921252 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9zvl2\"" May 21 14:40:14.921438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.921271 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:40:14.921438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.921245 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:40:14.921438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.921289 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:40:14.921438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.921256 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qcw62\"" May 21 14:40:14.984690 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.984656 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:14.984690 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:14.984692 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:14.985083 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:14.984781 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:14.985083 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:14.984785 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:14.985083 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:14.984839 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:16.984819494 +0000 UTC m=+38.655069587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:14.985083 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:14.984853 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:16.984846875 +0000 UTC m=+38.655096947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:15.068230 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:15.068195 2553 generic.go:358] "Generic (PLEG): container finished" podID="4a088b46-ed97-484c-b3be-575bef0b2c3e" containerID="b3c933be861fa0025177b19deb872fcaff05eba4576ba0207c209b4cf7225285" exitCode=0 May 21 14:40:15.068375 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:15.068270 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerDied","Data":"b3c933be861fa0025177b19deb872fcaff05eba4576ba0207c209b4cf7225285"} May 21 14:40:16.075484 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:16.075293 2553 generic.go:358] "Generic (PLEG): container finished" podID="4a088b46-ed97-484c-b3be-575bef0b2c3e" containerID="affe97057ba4fa7890070ddb875192bc7a49a49910e1df45aaff820466dbe3a4" exitCode=0 May 21 14:40:16.075996 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:16.075362 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerDied","Data":"affe97057ba4fa7890070ddb875192bc7a49a49910e1df45aaff820466dbe3a4"} May 21 14:40:16.999929 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:16.999899 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:17.000028 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:16.999940 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:17.000072 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:17.000050 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:17.000121 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:17.000103 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:17.000121 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:17.000120 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:21.000104374 +0000 UTC m=+42.670354467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:17.000185 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:17.000157 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:21.000142233 +0000 UTC m=+42.670392318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:17.080585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:17.080553 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7dff" event={"ID":"4a088b46-ed97-484c-b3be-575bef0b2c3e","Type":"ContainerStarted","Data":"3fd4499dbdf66ecc40cde7bcdaca1b40c3dca184a3a782c0a386887fb136c9ae"} May 21 14:40:17.110694 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:17.110645 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g7dff" podStartSLOduration=5.237913708 podStartE2EDuration="38.110630946s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:39:41.611790721 +0000 UTC m=+3.282040797" lastFinishedPulling="2026-05-21 14:40:14.484507948 +0000 UTC m=+36.154758035" observedRunningTime="2026-05-21 14:40:17.109278351 +0000 UTC m=+38.779528446" watchObservedRunningTime="2026-05-21 14:40:17.110630946 +0000 UTC m=+38.780881041" May 21 14:40:21.029713 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:21.029669 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:21.030089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:21.029774 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:21.030089 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:21.029835 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:21.030089 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:21.029861 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:21.030089 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:21.029911 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:29.029890541 +0000 UTC m=+50.700140625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:21.030089 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:21.029927 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:29.02992004 +0000 UTC m=+50.700170112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:29.082406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:29.082358 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:29.082889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:29.082423 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:29.082889 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:29.082523 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:29.082889 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:29.082578 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:29.082889 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:29.082590 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:45.082574423 +0000 UTC m=+66.752824500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:29.082889 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:29.082627 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:40:45.082612629 +0000 UTC m=+66.752862703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:40.980691 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:40.980664 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljv64" May 21 14:40:44.592972 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.592932 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:40:44.595335 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.595314 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:40:44.603183 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:44.603163 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:40:44.603248 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:44.603231 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:41:48.603209208 +0000 UTC m=+130.273459303 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : secret "metrics-daemon-secret" not found May 21 14:40:44.693846 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.693813 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:44.696474 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.696456 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:40:44.706886 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.706864 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:40:44.718192 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.718156 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xncqz\" (UniqueName: \"kubernetes.io/projected/ebb38515-240a-4f84-94f8-f8d541868811-kube-api-access-xncqz\") pod \"network-check-target-7g2ws\" (UID: \"ebb38515-240a-4f84-94f8-f8d541868811\") " pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:44.930481 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.930400 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9zvl2\"" May 21 14:40:44.938533 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:44.938515 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:45.097079 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.097044 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:40:45.097233 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.097121 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:40:45.097233 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:45.097201 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:40:45.097319 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:45.097274 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:17.097254658 +0000 UTC m=+98.767504736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:40:45.097319 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:45.097208 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:40:45.097401 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:40:45.097330 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:17.097319391 +0000 UTC m=+98.767569464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:40:45.132130 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.132100 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7g2ws"] May 21 14:40:45.135567 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:40:45.135534 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb38515_240a_4f84_94f8_f8d541868811.slice/crio-3edd4fcb21268b5c1a2652c3d5fcc50618ccfe2d6721ed76c48f8fe9bebab91a WatchSource:0}: Error finding container 3edd4fcb21268b5c1a2652c3d5fcc50618ccfe2d6721ed76c48f8fe9bebab91a: Status 404 returned error can't find the container with id 3edd4fcb21268b5c1a2652c3d5fcc50618ccfe2d6721ed76c48f8fe9bebab91a May 21 14:40:45.139021 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.138994 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7g2ws" event={"ID":"ebb38515-240a-4f84-94f8-f8d541868811","Type":"ContainerStarted","Data":"3edd4fcb21268b5c1a2652c3d5fcc50618ccfe2d6721ed76c48f8fe9bebab91a"} May 21 14:40:45.299273 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.299229 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:45.301929 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.301907 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:40:45.312209 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.312168 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b-original-pull-secret\") pod \"global-pull-secret-syncer-mmt24\" (UID: \"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b\") " pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:45.534769 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.534735 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mmt24" May 21 14:40:45.678297 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:45.678257 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mmt24"] May 21 14:40:45.681765 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:40:45.681736 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbeb68c7_5f43_45f6_b6d2_a9dd18317e4b.slice/crio-8506cab1f053d3e295bd6c7e201750f4725c1dd7bd8b478553492e5d15302f07 WatchSource:0}: Error finding container 8506cab1f053d3e295bd6c7e201750f4725c1dd7bd8b478553492e5d15302f07: Status 404 returned error can't find the container with id 8506cab1f053d3e295bd6c7e201750f4725c1dd7bd8b478553492e5d15302f07 May 21 14:40:46.142566 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:46.142527 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mmt24" event={"ID":"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b","Type":"ContainerStarted","Data":"8506cab1f053d3e295bd6c7e201750f4725c1dd7bd8b478553492e5d15302f07"} May 21 14:40:48.148622 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:48.148583 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7g2ws" event={"ID":"ebb38515-240a-4f84-94f8-f8d541868811","Type":"ContainerStarted","Data":"0db83c2cd14fa8c33d9ddc5c1112a4eeea89d15d41b8d3062d9a162fc622a9fe"} May 21 14:40:48.149120 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:48.148702 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:40:48.167996 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:48.167949 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7g2ws" podStartSLOduration=66.284591185 podStartE2EDuration="1m9.16793501s" podCreationTimestamp="2026-05-21 14:39:39 +0000 UTC" firstStartedPulling="2026-05-21 14:40:45.137551404 +0000 UTC m=+66.807801477" lastFinishedPulling="2026-05-21 14:40:48.02089523 +0000 UTC m=+69.691145302" observedRunningTime="2026-05-21 14:40:48.167237586 +0000 UTC m=+69.837487682" watchObservedRunningTime="2026-05-21 14:40:48.16793501 +0000 UTC m=+69.838185393" May 21 14:40:50.153988 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:50.153951 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mmt24" event={"ID":"dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b","Type":"ContainerStarted","Data":"e19dd91c180d1020901c60c03f9bfcb3e8d882dc42300f0d099f7161429badfb"} May 21 14:40:50.172451 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:40:50.172375 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mmt24" podStartSLOduration=65.210376197 podStartE2EDuration="1m9.172360384s" podCreationTimestamp="2026-05-21 14:39:41 +0000 UTC" firstStartedPulling="2026-05-21 14:40:45.683839512 +0000 UTC m=+67.354089585" lastFinishedPulling="2026-05-21 14:40:49.6458237 +0000 UTC m=+71.316073772" observedRunningTime="2026-05-21 14:40:50.172051497 +0000 UTC m=+71.842301595" watchObservedRunningTime="2026-05-21 14:40:50.172360384 +0000 UTC m=+71.842610479" May 21 14:41:17.125054 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:17.125013 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:41:17.125472 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:17.125088 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:41:17.125472 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:17.125156 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:41:17.125472 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:17.125235 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls podName:b2ddd360-2983-47bf-89d1-2164226fcc32 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:21.125219191 +0000 UTC m=+162.795469265 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls") pod "dns-default-7qrnt" (UID: "b2ddd360-2983-47bf-89d1-2164226fcc32") : secret "dns-default-metrics-tls" not found May 21 14:41:17.125472 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:17.125165 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:41:17.125472 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:17.125297 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert podName:f8d98097-5c36-4d83-a6f2-3b6e4242b4e5 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:21.125284674 +0000 UTC m=+162.795534750 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert") pod "ingress-canary-fmq5c" (UID: "f8d98097-5c36-4d83-a6f2-3b6e4242b4e5") : secret "canary-serving-cert" not found May 21 14:41:19.153447 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:19.153410 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7g2ws" May 21 14:41:46.706604 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.706565 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq"] May 21 14:41:46.708274 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.708258 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.710540 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.710506 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-45vt4\"" May 21 14:41:46.710649 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.710559 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 14:41:46.710649 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.710559 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 14:41:46.711389 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.711371 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 14:41:46.711529 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.711441 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 14:41:46.713205 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.713187 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pkljv"] May 21 14:41:46.715245 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.715107 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.717650 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.717614 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wjt2d\"" May 21 14:41:46.718335 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.718316 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 14:41:46.718471 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.718452 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq"] May 21 14:41:46.718676 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.718661 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 14:41:46.719041 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.719022 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 14:41:46.719144 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.719129 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 14:41:46.723911 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.723892 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 14:41:46.726358 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.726340 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pkljv"] May 21 14:41:46.809065 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.809033 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb"] May 21 14:41:46.813625 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.812721 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" May 21 14:41:46.813794 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.813669 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm"] May 21 14:41:46.816095 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.816075 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-776bfd778d-47ksc"] May 21 14:41:46.816234 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.816216 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:46.817047 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.817028 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 14:41:46.817239 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.817221 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 14:41:46.817410 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.817393 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9hbpc\"" May 21 14:41:46.817752 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.817734 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:46.818342 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.818325 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 14:41:46.818439 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.818423 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 14:41:46.818571 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.818553 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 14:41:46.818644 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.818609 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mx5c4\"" May 21 14:41:46.819798 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.819779 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 14:41:46.820130 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.820108 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:41:46.820357 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.820252 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 14:41:46.820357 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.820303 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cqgls\"" May 21 14:41:46.820754 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.820733 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 14:41:46.820862 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.820794 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:41:46.820941 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.820927 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 14:41:46.822811 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.822792 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb"] May 21 14:41:46.828812 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.828796 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-776bfd778d-47ksc"] May 21 14:41:46.832614 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832588 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4d8051-9b47-443d-ac67-0fa1cae53c61-trusted-ca\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.832724 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832701 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e4d8051-9b47-443d-ac67-0fa1cae53c61-config\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.832811 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832789 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4d8051-9b47-443d-ac67-0fa1cae53c61-serving-cert\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.832934 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832832 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/626a8ad3-e045-40c3-9d40-ac19a64e123f-config\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.832934 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832857 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqmnr\" (UniqueName: \"kubernetes.io/projected/9e4d8051-9b47-443d-ac67-0fa1cae53c61-kube-api-access-wqmnr\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.832934 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78rhb\" (UniqueName: \"kubernetes.io/projected/626a8ad3-e045-40c3-9d40-ac19a64e123f-kube-api-access-78rhb\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.833188 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.832960 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/626a8ad3-e045-40c3-9d40-ac19a64e123f-serving-cert\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.843034 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.843002 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm"] May 21 14:41:46.934050 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934016 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4d8051-9b47-443d-ac67-0fa1cae53c61-serving-cert\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934065 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/626a8ad3-e045-40c3-9d40-ac19a64e123f-config\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934088 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqmnr\" (UniqueName: \"kubernetes.io/projected/9e4d8051-9b47-443d-ac67-0fa1cae53c61-kube-api-access-wqmnr\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934115 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78rhb\" (UniqueName: \"kubernetes.io/projected/626a8ad3-e045-40c3-9d40-ac19a64e123f-kube-api-access-78rhb\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934142 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/626a8ad3-e045-40c3-9d40-ac19a64e123f-serving-cert\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934170 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934205 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdn4\" (UniqueName: \"kubernetes.io/projected/9ae283c0-ffd8-4c67-abce-baae0af8140f-kube-api-access-htdn4\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:46.934255 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934240 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4d8051-9b47-443d-ac67-0fa1cae53c61-trusted-ca\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934263 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-default-certificate\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934345 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-stats-auth\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934403 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5cp\" (UniqueName: \"kubernetes.io/projected/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-kube-api-access-dc5cp\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934467 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e4d8051-9b47-443d-ac67-0fa1cae53c61-config\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.934663 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934516 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vwsf\" (UniqueName: \"kubernetes.io/projected/6fea1369-3959-4288-ad94-889c651bc285-kube-api-access-6vwsf\") pod \"volume-data-source-validator-5cf8c89d64-p97bb\" (UID: \"6fea1369-3959-4288-ad94-889c651bc285\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" May 21 14:41:46.934990 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.934725 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/626a8ad3-e045-40c3-9d40-ac19a64e123f-config\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.935183 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.935158 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e4d8051-9b47-443d-ac67-0fa1cae53c61-config\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.935183 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.935175 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4d8051-9b47-443d-ac67-0fa1cae53c61-trusted-ca\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.936482 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.936462 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/626a8ad3-e045-40c3-9d40-ac19a64e123f-serving-cert\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:46.936667 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.936651 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4d8051-9b47-443d-ac67-0fa1cae53c61-serving-cert\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.943874 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.943852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqmnr\" (UniqueName: \"kubernetes.io/projected/9e4d8051-9b47-443d-ac67-0fa1cae53c61-kube-api-access-wqmnr\") pod \"console-operator-76dff48d59-pkljv\" (UID: \"9e4d8051-9b47-443d-ac67-0fa1cae53c61\") " pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:46.943961 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:46.943914 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78rhb\" (UniqueName: \"kubernetes.io/projected/626a8ad3-e045-40c3-9d40-ac19a64e123f-kube-api-access-78rhb\") pod \"service-ca-operator-57b5b68b8-49jgq\" (UID: \"626a8ad3-e045-40c3-9d40-ac19a64e123f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:47.017969 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.017929 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" May 21 14:41:47.025790 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.025761 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:47.035068 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035044 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:47.035175 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035099 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htdn4\" (UniqueName: \"kubernetes.io/projected/9ae283c0-ffd8-4c67-abce-baae0af8140f-kube-api-access-htdn4\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:47.035175 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035147 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-default-certificate\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.035276 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035189 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.035276 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.035206 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:41:47.035276 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035220 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-stats-auth\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.035418 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.035293 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls podName:9ae283c0-ffd8-4c67-abce-baae0af8140f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:47.535271152 +0000 UTC m=+129.205521226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls") pod "cluster-samples-operator-697587599-jgbzm" (UID: "9ae283c0-ffd8-4c67-abce-baae0af8140f") : secret "samples-operator-tls" not found May 21 14:41:47.035418 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.035346 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:47.535327858 +0000 UTC m=+129.205577965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : configmap references non-existent config key: service-ca.crt May 21 14:41:47.035418 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035395 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.035598 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035441 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5cp\" (UniqueName: \"kubernetes.io/projected/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-kube-api-access-dc5cp\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.035598 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.035486 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vwsf\" (UniqueName: \"kubernetes.io/projected/6fea1369-3959-4288-ad94-889c651bc285-kube-api-access-6vwsf\") pod \"volume-data-source-validator-5cf8c89d64-p97bb\" (UID: \"6fea1369-3959-4288-ad94-889c651bc285\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" May 21 14:41:47.035598 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.035553 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:41:47.035755 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.035610 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:47.53559396 +0000 UTC m=+129.205844243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : secret "router-metrics-certs-default" not found May 21 14:41:47.037726 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.037707 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-default-certificate\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.037907 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.037882 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-stats-auth\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.045904 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.045875 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vwsf\" (UniqueName: \"kubernetes.io/projected/6fea1369-3959-4288-ad94-889c651bc285-kube-api-access-6vwsf\") pod \"volume-data-source-validator-5cf8c89d64-p97bb\" (UID: \"6fea1369-3959-4288-ad94-889c651bc285\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" May 21 14:41:47.046362 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.046346 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdn4\" (UniqueName: \"kubernetes.io/projected/9ae283c0-ffd8-4c67-abce-baae0af8140f-kube-api-access-htdn4\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:47.049752 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.049727 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5cp\" (UniqueName: \"kubernetes.io/projected/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-kube-api-access-dc5cp\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.123564 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.123533 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" May 21 14:41:47.149528 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.149482 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq"] May 21 14:41:47.154399 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:41:47.154372 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626a8ad3_e045_40c3_9d40_ac19a64e123f.slice/crio-9af7a2be8d1f6cfcd0188ae744523df93721e5ccb30e7cb2841dbacb937ba620 WatchSource:0}: Error finding container 9af7a2be8d1f6cfcd0188ae744523df93721e5ccb30e7cb2841dbacb937ba620: Status 404 returned error can't find the container with id 9af7a2be8d1f6cfcd0188ae744523df93721e5ccb30e7cb2841dbacb937ba620 May 21 14:41:47.166065 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.166039 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pkljv"] May 21 14:41:47.168890 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:41:47.168865 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4d8051_9b47_443d_ac67_0fa1cae53c61.slice/crio-0666c8f4950780390a354fa89502422e1e5681a6b6d234fce24a2d0ac4ace57a WatchSource:0}: Error finding container 0666c8f4950780390a354fa89502422e1e5681a6b6d234fce24a2d0ac4ace57a: Status 404 returned error can't find the container with id 0666c8f4950780390a354fa89502422e1e5681a6b6d234fce24a2d0ac4ace57a May 21 14:41:47.250166 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.250136 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb"] May 21 14:41:47.253374 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:41:47.253349 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fea1369_3959_4288_ad94_889c651bc285.slice/crio-da3f2028aae1995a1f6ffff8c5223303291a9b28330218113fbc6575cbf642dc WatchSource:0}: Error finding container da3f2028aae1995a1f6ffff8c5223303291a9b28330218113fbc6575cbf642dc: Status 404 returned error can't find the container with id da3f2028aae1995a1f6ffff8c5223303291a9b28330218113fbc6575cbf642dc May 21 14:41:47.266406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.266379 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" event={"ID":"626a8ad3-e045-40c3-9d40-ac19a64e123f","Type":"ContainerStarted","Data":"9af7a2be8d1f6cfcd0188ae744523df93721e5ccb30e7cb2841dbacb937ba620"} May 21 14:41:47.267314 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.267291 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" event={"ID":"6fea1369-3959-4288-ad94-889c651bc285","Type":"ContainerStarted","Data":"da3f2028aae1995a1f6ffff8c5223303291a9b28330218113fbc6575cbf642dc"} May 21 14:41:47.268240 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.268183 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" event={"ID":"9e4d8051-9b47-443d-ac67-0fa1cae53c61","Type":"ContainerStarted","Data":"0666c8f4950780390a354fa89502422e1e5681a6b6d234fce24a2d0ac4ace57a"} May 21 14:41:47.539573 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.539463 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.539573 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.539529 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:47.539819 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:47.539607 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:47.539819 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.539644 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:48.539623988 +0000 UTC m=+130.209874061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : configmap references non-existent config key: service-ca.crt May 21 14:41:47.539819 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.539699 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:41:47.539819 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.539750 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls podName:9ae283c0-ffd8-4c67-abce-baae0af8140f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:48.539735231 +0000 UTC m=+130.209985305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls") pod "cluster-samples-operator-697587599-jgbzm" (UID: "9ae283c0-ffd8-4c67-abce-baae0af8140f") : secret "samples-operator-tls" not found May 21 14:41:47.539819 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.539699 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:41:47.539819 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:47.539808 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:48.539797483 +0000 UTC m=+130.210047560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : secret "router-metrics-certs-default" not found May 21 14:41:48.547919 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:48.547879 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:48.547942 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:48.548019 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.548044 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:50.548019921 +0000 UTC m=+132.218270005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : configmap references non-existent config key: service-ca.crt May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.548115 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.548116 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.548174 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls podName:9ae283c0-ffd8-4c67-abce-baae0af8140f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:50.548158874 +0000 UTC m=+132.218408959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls") pod "cluster-samples-operator-697587599-jgbzm" (UID: "9ae283c0-ffd8-4c67-abce-baae0af8140f") : secret "samples-operator-tls" not found May 21 14:41:48.548389 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.548248 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:50.54823468 +0000 UTC m=+132.218484757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : secret "router-metrics-certs-default" not found May 21 14:41:48.649188 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:48.649156 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:41:48.649345 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.649305 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:41:48.649407 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:48.649377 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs podName:f0ff1ed8-1a76-4f9f-a243-8a159873b6ab nodeName:}" failed. No retries permitted until 2026-05-21 14:43:50.649353822 +0000 UTC m=+252.319603908 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs") pod "network-metrics-daemon-2lsrm" (UID: "f0ff1ed8-1a76-4f9f-a243-8a159873b6ab") : secret "metrics-daemon-secret" not found May 21 14:41:49.274072 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:49.274036 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" event={"ID":"6fea1369-3959-4288-ad94-889c651bc285","Type":"ContainerStarted","Data":"16c4dd53e61766b450c933272432d50a596bcbc5cfb6ee80d743f5087df70447"} May 21 14:41:49.292850 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:49.292795 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p97bb" podStartSLOduration=1.920141842 podStartE2EDuration="3.292780428s" podCreationTimestamp="2026-05-21 14:41:46 +0000 UTC" firstStartedPulling="2026-05-21 14:41:47.255073676 +0000 UTC m=+128.925323750" lastFinishedPulling="2026-05-21 14:41:48.627712244 +0000 UTC m=+130.297962336" observedRunningTime="2026-05-21 14:41:49.291709958 +0000 UTC m=+130.961960055" watchObservedRunningTime="2026-05-21 14:41:49.292780428 +0000 UTC m=+130.963030523" May 21 14:41:50.277317 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.277276 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" event={"ID":"9e4d8051-9b47-443d-ac67-0fa1cae53c61","Type":"ContainerStarted","Data":"c42ccbd2546268c962ca930198df2154520efced5ed67dc03ff8105bd0fb24f4"} May 21 14:41:50.277814 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.277513 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:50.278701 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.278672 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" event={"ID":"626a8ad3-e045-40c3-9d40-ac19a64e123f","Type":"ContainerStarted","Data":"ce2bea2f7352f9d36f2a2f9878e8ee2461e025960d30897bee57457951e26416"} May 21 14:41:50.279080 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.279049 2553 patch_prober.go:28] interesting pod/console-operator-76dff48d59-pkljv container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= May 21 14:41:50.279185 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.279093 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" podUID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" May 21 14:41:50.295430 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.295103 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" podStartSLOduration=1.261362917 podStartE2EDuration="4.29508533s" podCreationTimestamp="2026-05-21 14:41:46 +0000 UTC" firstStartedPulling="2026-05-21 14:41:47.170606216 +0000 UTC m=+128.840856290" lastFinishedPulling="2026-05-21 14:41:50.204328615 +0000 UTC m=+131.874578703" observedRunningTime="2026-05-21 14:41:50.294296512 +0000 UTC m=+131.964546607" watchObservedRunningTime="2026-05-21 14:41:50.29508533 +0000 UTC m=+131.965335430" May 21 14:41:50.314403 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.314277 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" podStartSLOduration=1.264895968 podStartE2EDuration="4.314259409s" podCreationTimestamp="2026-05-21 14:41:46 +0000 UTC" firstStartedPulling="2026-05-21 14:41:47.156173912 +0000 UTC m=+128.826423988" lastFinishedPulling="2026-05-21 14:41:50.20553734 +0000 UTC m=+131.875787429" observedRunningTime="2026-05-21 14:41:50.314156848 +0000 UTC m=+131.984406944" watchObservedRunningTime="2026-05-21 14:41:50.314259409 +0000 UTC m=+131.984509506" May 21 14:41:50.564476 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.564440 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:50.564675 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.564526 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:50.564675 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:50.564548 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:50.564675 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:50.564612 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:41:50.564675 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:50.564649 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:41:50.564853 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:50.564697 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls podName:9ae283c0-ffd8-4c67-abce-baae0af8140f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:54.564676287 +0000 UTC m=+136.234926367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls") pod "cluster-samples-operator-697587599-jgbzm" (UID: "9ae283c0-ffd8-4c67-abce-baae0af8140f") : secret "samples-operator-tls" not found May 21 14:41:50.564853 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:50.564717 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:54.564707682 +0000 UTC m=+136.234957764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : secret "router-metrics-certs-default" not found May 21 14:41:50.564853 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:50.564733 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:54.564724751 +0000 UTC m=+136.234974824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : configmap references non-existent config key: service-ca.crt May 21 14:41:51.281657 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:51.281629 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/0.log" May 21 14:41:51.282072 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:51.281669 2553 generic.go:358] "Generic (PLEG): container finished" podID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" containerID="c42ccbd2546268c962ca930198df2154520efced5ed67dc03ff8105bd0fb24f4" exitCode=255 May 21 14:41:51.282072 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:51.281704 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" event={"ID":"9e4d8051-9b47-443d-ac67-0fa1cae53c61","Type":"ContainerDied","Data":"c42ccbd2546268c962ca930198df2154520efced5ed67dc03ff8105bd0fb24f4"} May 21 14:41:51.282072 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:51.282009 2553 scope.go:117] "RemoveContainer" containerID="c42ccbd2546268c962ca930198df2154520efced5ed67dc03ff8105bd0fb24f4" May 21 14:41:52.114504 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.114472 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7sqdr_da333afb-a4e4-4356-abd5-02bbcf4c207c/dns-node-resolver/0.log" May 21 14:41:52.285145 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.285115 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:41:52.285555 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.285449 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/0.log" May 21 14:41:52.285555 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.285478 2553 generic.go:358] "Generic (PLEG): container finished" podID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" containerID="afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231" exitCode=255 May 21 14:41:52.285555 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.285538 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" event={"ID":"9e4d8051-9b47-443d-ac67-0fa1cae53c61","Type":"ContainerDied","Data":"afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231"} May 21 14:41:52.285681 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.285577 2553 scope.go:117] "RemoveContainer" containerID="c42ccbd2546268c962ca930198df2154520efced5ed67dc03ff8105bd0fb24f4" May 21 14:41:52.285858 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:52.285840 2553 scope.go:117] "RemoveContainer" containerID="afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231" May 21 14:41:52.286062 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:52.286035 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pkljv_openshift-console-operator(9e4d8051-9b47-443d-ac67-0fa1cae53c61)\"" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" podUID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" May 21 14:41:53.288472 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:53.288445 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:41:53.288972 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:53.288884 2553 scope.go:117] "RemoveContainer" containerID="afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231" May 21 14:41:53.289118 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:53.289096 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pkljv_openshift-console-operator(9e4d8051-9b47-443d-ac67-0fa1cae53c61)\"" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" podUID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" May 21 14:41:53.514126 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:53.514097 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j9bjz_c275336e-90a5-4db0-bd89-976e0a057107/node-ca/0.log" May 21 14:41:54.307855 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.307817 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-j872k"] May 21 14:41:54.310666 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.310643 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.312842 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.312818 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 14:41:54.313627 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.313606 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 14:41:54.313757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.313687 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sjzg2\"" May 21 14:41:54.313757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.313744 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 14:41:54.313852 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.313777 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 14:41:54.320619 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.320597 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-j872k"] May 21 14:41:54.398210 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.398171 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r97gr\" (UniqueName: \"kubernetes.io/projected/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-kube-api-access-r97gr\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.398393 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.398224 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-signing-key\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.398393 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.398242 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-signing-cabundle\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.499511 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.499458 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r97gr\" (UniqueName: \"kubernetes.io/projected/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-kube-api-access-r97gr\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.499678 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.499578 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-signing-key\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.499678 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.499600 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-signing-cabundle\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.500218 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.500196 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-signing-cabundle\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.501964 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.501949 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-signing-key\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.508750 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.508726 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r97gr\" (UniqueName: \"kubernetes.io/projected/81653d41-5bb1-44ee-abe6-9af2f5b76fb1-kube-api-access-r97gr\") pod \"service-ca-67d667c7d-j872k\" (UID: \"81653d41-5bb1-44ee-abe6-9af2f5b76fb1\") " pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.600060 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.599970 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:41:54.600060 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.600033 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:54.600060 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.600059 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:41:54.600268 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:54.600135 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:41:54.600268 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:54.600180 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.600155351 +0000 UTC m=+144.270405438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : configmap references non-existent config key: service-ca.crt May 21 14:41:54.600268 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:54.600201 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls podName:9ae283c0-ffd8-4c67-abce-baae0af8140f nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.600192868 +0000 UTC m=+144.270442947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls") pod "cluster-samples-operator-697587599-jgbzm" (UID: "9ae283c0-ffd8-4c67-abce-baae0af8140f") : secret "samples-operator-tls" not found May 21 14:41:54.600268 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:54.600140 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:41:54.600268 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:54.600261 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs podName:f62ca4a3-ffac-4fb8-a123-a2e513279dd7 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.600249517 +0000 UTC m=+144.270499590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs") pod "router-default-776bfd778d-47ksc" (UID: "f62ca4a3-ffac-4fb8-a123-a2e513279dd7") : secret "router-metrics-certs-default" not found May 21 14:41:54.619066 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.619035 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-j872k" May 21 14:41:54.743212 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:54.743177 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-j872k"] May 21 14:41:54.746179 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:41:54.746143 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81653d41_5bb1_44ee_abe6_9af2f5b76fb1.slice/crio-08c574589f1f19a710d675ae65c00713ba9a24af1bf8e8f6825d54abce9181c0 WatchSource:0}: Error finding container 08c574589f1f19a710d675ae65c00713ba9a24af1bf8e8f6825d54abce9181c0: Status 404 returned error can't find the container with id 08c574589f1f19a710d675ae65c00713ba9a24af1bf8e8f6825d54abce9181c0 May 21 14:41:55.294582 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:55.294544 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-j872k" event={"ID":"81653d41-5bb1-44ee-abe6-9af2f5b76fb1","Type":"ContainerStarted","Data":"8b46aff184504b99aab813854ddab2564e06c857e50dcffc62ddaa47415ae812"} May 21 14:41:55.294582 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:55.294583 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-j872k" event={"ID":"81653d41-5bb1-44ee-abe6-9af2f5b76fb1","Type":"ContainerStarted","Data":"08c574589f1f19a710d675ae65c00713ba9a24af1bf8e8f6825d54abce9181c0"} May 21 14:41:55.311102 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:55.311042 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-j872k" podStartSLOduration=1.311025737 podStartE2EDuration="1.311025737s" podCreationTimestamp="2026-05-21 14:41:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:41:55.310691571 +0000 UTC m=+136.980941666" watchObservedRunningTime="2026-05-21 14:41:55.311025737 +0000 UTC m=+136.981275833" May 21 14:41:57.026810 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:57.026780 2553 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:41:57.027159 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:41:57.027120 2553 scope.go:117] "RemoveContainer" containerID="afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231" May 21 14:41:57.027285 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:41:57.027268 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pkljv_openshift-console-operator(9e4d8051-9b47-443d-ac67-0fa1cae53c61)\"" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" podUID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" May 21 14:42:00.277980 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:00.277935 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:42:00.278432 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:00.278340 2553 scope.go:117] "RemoveContainer" containerID="afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231" May 21 14:42:00.278564 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:00.278545 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pkljv_openshift-console-operator(9e4d8051-9b47-443d-ac67-0fa1cae53c61)\"" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" podUID="9e4d8051-9b47-443d-ac67-0fa1cae53c61" May 21 14:42:02.672824 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.672783 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:42:02.673207 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.672849 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:02.673207 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.672877 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:02.673560 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.673537 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-service-ca-bundle\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:02.675330 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.675306 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae283c0-ffd8-4c67-abce-baae0af8140f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jgbzm\" (UID: \"9ae283c0-ffd8-4c67-abce-baae0af8140f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:42:02.675416 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.675306 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f62ca4a3-ffac-4fb8-a123-a2e513279dd7-metrics-certs\") pod \"router-default-776bfd778d-47ksc\" (UID: \"f62ca4a3-ffac-4fb8-a123-a2e513279dd7\") " pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:02.730416 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.730387 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" May 21 14:42:02.735192 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.735168 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:02.868034 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.867995 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm"] May 21 14:42:02.895276 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:02.895250 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-776bfd778d-47ksc"] May 21 14:42:02.901626 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:02.901598 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62ca4a3_ffac_4fb8_a123_a2e513279dd7.slice/crio-4d84f672ca5e3b0511675629f3d837a7555a65aae6e6f055fb507e222482f964 WatchSource:0}: Error finding container 4d84f672ca5e3b0511675629f3d837a7555a65aae6e6f055fb507e222482f964: Status 404 returned error can't find the container with id 4d84f672ca5e3b0511675629f3d837a7555a65aae6e6f055fb507e222482f964 May 21 14:42:03.314428 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:03.314385 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-776bfd778d-47ksc" event={"ID":"f62ca4a3-ffac-4fb8-a123-a2e513279dd7","Type":"ContainerStarted","Data":"576c43567d4b48e87e948503448b7ed805a7316f6c5e145eb82173be9ce2ada1"} May 21 14:42:03.314642 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:03.314432 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-776bfd778d-47ksc" event={"ID":"f62ca4a3-ffac-4fb8-a123-a2e513279dd7","Type":"ContainerStarted","Data":"4d84f672ca5e3b0511675629f3d837a7555a65aae6e6f055fb507e222482f964"} May 21 14:42:03.315324 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:03.315301 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" event={"ID":"9ae283c0-ffd8-4c67-abce-baae0af8140f","Type":"ContainerStarted","Data":"7fd31d605354530927438feb7e818794fcab5555c3ba8774340bd8fbfdeb4a43"} May 21 14:42:03.335506 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:03.335439 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-776bfd778d-47ksc" podStartSLOduration=17.335422297 podStartE2EDuration="17.335422297s" podCreationTimestamp="2026-05-21 14:41:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:42:03.334743812 +0000 UTC m=+145.004993911" watchObservedRunningTime="2026-05-21 14:42:03.335422297 +0000 UTC m=+145.005672393" May 21 14:42:03.736361 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:03.736272 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:03.739456 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:03.739430 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:04.317626 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:04.317591 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:04.318937 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:04.318916 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-776bfd778d-47ksc" May 21 14:42:05.321926 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:05.321879 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" event={"ID":"9ae283c0-ffd8-4c67-abce-baae0af8140f","Type":"ContainerStarted","Data":"3ef12d2a2c94863a460b3cba8046a78c3da362b494698dedfd0e1d91fd5a53f9"} May 21 14:42:05.321926 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:05.321919 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" event={"ID":"9ae283c0-ffd8-4c67-abce-baae0af8140f","Type":"ContainerStarted","Data":"f9dc4a7e6e5c2cd8f034caf6289b93dd42d9b8cf4593bcb0eee555b75bd64d93"} May 21 14:42:05.342627 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:05.342573 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jgbzm" podStartSLOduration=17.434284561 podStartE2EDuration="19.342558749s" podCreationTimestamp="2026-05-21 14:41:46 +0000 UTC" firstStartedPulling="2026-05-21 14:42:02.915856598 +0000 UTC m=+144.586106671" lastFinishedPulling="2026-05-21 14:42:04.824130769 +0000 UTC m=+146.494380859" observedRunningTime="2026-05-21 14:42:05.342019258 +0000 UTC m=+147.012269352" watchObservedRunningTime="2026-05-21 14:42:05.342558749 +0000 UTC m=+147.012808844" May 21 14:42:10.918464 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:10.918435 2553 scope.go:117] "RemoveContainer" containerID="afa19676daa1642b6c6ca63945c73c5cfa48ea92f8064c4e1fefd9e4a60db231" May 21 14:42:11.340318 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:11.340207 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:42:11.340318 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:11.340299 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" event={"ID":"9e4d8051-9b47-443d-ac67-0fa1cae53c61","Type":"ContainerStarted","Data":"3cfac35cf8780d05a83007743d4acd70a43d6819acbfa04955d496c979f85f63"} May 21 14:42:11.340733 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:11.340702 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:42:11.347343 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:11.347303 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-pkljv" May 21 14:42:16.228105 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:16.228057 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7qrnt" podUID="b2ddd360-2983-47bf-89d1-2164226fcc32" May 21 14:42:16.240818 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:16.240795 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fmq5c" podUID="f8d98097-5c36-4d83-a6f2-3b6e4242b4e5" May 21 14:42:16.354342 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:16.354305 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7qrnt" May 21 14:42:17.681166 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.681135 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x8gzj"] May 21 14:42:17.684274 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.684252 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.686897 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.686870 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9fncb\"" May 21 14:42:17.687929 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.687903 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:42:17.688061 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.687949 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:42:17.688061 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.687903 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:42:17.688272 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.688253 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:42:17.733862 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.733830 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8gzj"] May 21 14:42:17.781752 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.781722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-data-volume\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.781923 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.781771 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.781923 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.781804 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-crio-socket\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.781923 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.781875 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4wxv\" (UniqueName: \"kubernetes.io/projected/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-kube-api-access-q4wxv\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.781923 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.781893 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.882635 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.882548 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.882635 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.882586 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-crio-socket\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.882828 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.882636 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4wxv\" (UniqueName: \"kubernetes.io/projected/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-kube-api-access-q4wxv\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.882828 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.882657 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.882828 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.882688 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-data-volume\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.882828 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.882749 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-crio-socket\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.883041 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.883019 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-data-volume\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.883165 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.883137 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.885134 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.885114 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.897794 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.897771 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4wxv\" (UniqueName: \"kubernetes.io/projected/f4e49e22-5aa1-49ca-a23c-c3f8eed39830-kube-api-access-q4wxv\") pod \"insights-runtime-extractor-x8gzj\" (UID: \"f4e49e22-5aa1-49ca-a23c-c3f8eed39830\") " pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:17.938321 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:17.938282 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2lsrm" podUID="f0ff1ed8-1a76-4f9f-a243-8a159873b6ab" May 21 14:42:17.995646 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:17.995605 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8gzj" May 21 14:42:18.117017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:18.116986 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8gzj"] May 21 14:42:18.119748 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:18.119706 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e49e22_5aa1_49ca_a23c_c3f8eed39830.slice/crio-b2086d731cb219abfeb1b06287eed8a296c838fcbbc63c41c0e5f6842eac8d8f WatchSource:0}: Error finding container b2086d731cb219abfeb1b06287eed8a296c838fcbbc63c41c0e5f6842eac8d8f: Status 404 returned error can't find the container with id b2086d731cb219abfeb1b06287eed8a296c838fcbbc63c41c0e5f6842eac8d8f May 21 14:42:18.362028 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:18.361993 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8gzj" event={"ID":"f4e49e22-5aa1-49ca-a23c-c3f8eed39830","Type":"ContainerStarted","Data":"7fc9c32ae359f7055c8211c49d36542fc8b1ac5066dea742516af1db4ba369a0"} May 21 14:42:18.362028 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:18.362030 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8gzj" event={"ID":"f4e49e22-5aa1-49ca-a23c-c3f8eed39830","Type":"ContainerStarted","Data":"b2086d731cb219abfeb1b06287eed8a296c838fcbbc63c41c0e5f6842eac8d8f"} May 21 14:42:19.366314 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:19.366274 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8gzj" event={"ID":"f4e49e22-5aa1-49ca-a23c-c3f8eed39830","Type":"ContainerStarted","Data":"57c5f430522d80ea1e05c6c6cf0e85bce61d1ab8375c36f910996b21cd80d1c9"} May 21 14:42:21.205940 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.205832 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:42:21.206402 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.205973 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:42:21.208339 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.208312 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ddd360-2983-47bf-89d1-2164226fcc32-metrics-tls\") pod \"dns-default-7qrnt\" (UID: \"b2ddd360-2983-47bf-89d1-2164226fcc32\") " pod="openshift-dns/dns-default-7qrnt" May 21 14:42:21.208448 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.208383 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8d98097-5c36-4d83-a6f2-3b6e4242b4e5-cert\") pod \"ingress-canary-fmq5c\" (UID: \"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5\") " pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:42:21.373657 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.373621 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8gzj" event={"ID":"f4e49e22-5aa1-49ca-a23c-c3f8eed39830","Type":"ContainerStarted","Data":"40cd29bb47d0ce81f0655fba08420be6e97ddc06135a424782c1dd6c51c9604e"} May 21 14:42:21.401537 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.401467 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x8gzj" podStartSLOduration=1.746018995 podStartE2EDuration="4.40145411s" podCreationTimestamp="2026-05-21 14:42:17 +0000 UTC" firstStartedPulling="2026-05-21 14:42:18.191559489 +0000 UTC m=+159.861809562" lastFinishedPulling="2026-05-21 14:42:20.846994596 +0000 UTC m=+162.517244677" observedRunningTime="2026-05-21 14:42:21.399872173 +0000 UTC m=+163.070122268" watchObservedRunningTime="2026-05-21 14:42:21.40145411 +0000 UTC m=+163.071704202" May 21 14:42:21.458329 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.458246 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjhqp\"" May 21 14:42:21.465500 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.465473 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7qrnt" May 21 14:42:21.591387 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:21.591355 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7qrnt"] May 21 14:42:21.594591 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:21.594553 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ddd360_2983_47bf_89d1_2164226fcc32.slice/crio-0f4b246c1bd92b6015548dcf6fd2fe9eefd6dd04023b14db384b6c5bbd7d42bd WatchSource:0}: Error finding container 0f4b246c1bd92b6015548dcf6fd2fe9eefd6dd04023b14db384b6c5bbd7d42bd: Status 404 returned error can't find the container with id 0f4b246c1bd92b6015548dcf6fd2fe9eefd6dd04023b14db384b6c5bbd7d42bd May 21 14:42:22.377799 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:22.377756 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7qrnt" event={"ID":"b2ddd360-2983-47bf-89d1-2164226fcc32","Type":"ContainerStarted","Data":"0f4b246c1bd92b6015548dcf6fd2fe9eefd6dd04023b14db384b6c5bbd7d42bd"} May 21 14:42:22.970074 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:22.970037 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7"] May 21 14:42:22.972458 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:22.972436 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:22.974891 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:22.974870 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 14:42:22.975021 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:22.974917 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cpv8l\"" May 21 14:42:22.980639 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:22.980601 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7"] May 21 14:42:23.020962 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.020923 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90901083-e78b-4310-99f1-5f7f6e66e940-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7\" (UID: \"90901083-e78b-4310-99f1-5f7f6e66e940\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:23.121616 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.121486 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90901083-e78b-4310-99f1-5f7f6e66e940-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7\" (UID: \"90901083-e78b-4310-99f1-5f7f6e66e940\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:23.121616 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:23.121587 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 14:42:23.121716 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:23.121644 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90901083-e78b-4310-99f1-5f7f6e66e940-tls-certificates podName:90901083-e78b-4310-99f1-5f7f6e66e940 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:23.621630313 +0000 UTC m=+165.291880391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/90901083-e78b-4310-99f1-5f7f6e66e940-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" (UID: "90901083-e78b-4310-99f1-5f7f6e66e940") : secret "prometheus-operator-admission-webhook-tls" not found May 21 14:42:23.382312 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.382274 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7qrnt" event={"ID":"b2ddd360-2983-47bf-89d1-2164226fcc32","Type":"ContainerStarted","Data":"d73f215e38a34248271c5ae8f4b2a00a0d118c93e7ab4beaefca22de1cf9c128"} May 21 14:42:23.382312 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.382311 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7qrnt" event={"ID":"b2ddd360-2983-47bf-89d1-2164226fcc32","Type":"ContainerStarted","Data":"a86a3cc537626c7482800a837f7d12cd773d2be0870d9cbf5f30e592fede2c42"} May 21 14:42:23.382779 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.382408 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7qrnt" May 21 14:42:23.414341 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.414290 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7qrnt" podStartSLOduration=128.899497823 podStartE2EDuration="2m10.414276416s" podCreationTimestamp="2026-05-21 14:40:13 +0000 UTC" firstStartedPulling="2026-05-21 14:42:21.596384187 +0000 UTC m=+163.266634259" lastFinishedPulling="2026-05-21 14:42:23.111162777 +0000 UTC m=+164.781412852" observedRunningTime="2026-05-21 14:42:23.413770883 +0000 UTC m=+165.084020979" watchObservedRunningTime="2026-05-21 14:42:23.414276416 +0000 UTC m=+165.084526510" May 21 14:42:23.625885 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.625782 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90901083-e78b-4310-99f1-5f7f6e66e940-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7\" (UID: \"90901083-e78b-4310-99f1-5f7f6e66e940\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:23.628190 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.628168 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/90901083-e78b-4310-99f1-5f7f6e66e940-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7\" (UID: \"90901083-e78b-4310-99f1-5f7f6e66e940\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:23.884254 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:23.884160 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:24.010756 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:24.010724 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7"] May 21 14:42:24.013614 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:24.013587 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90901083_e78b_4310_99f1_5f7f6e66e940.slice/crio-7c47d8a170882b9858a2edd8c59020a26fb1aece05bea8927d384c1d4cdf4ee7 WatchSource:0}: Error finding container 7c47d8a170882b9858a2edd8c59020a26fb1aece05bea8927d384c1d4cdf4ee7: Status 404 returned error can't find the container with id 7c47d8a170882b9858a2edd8c59020a26fb1aece05bea8927d384c1d4cdf4ee7 May 21 14:42:24.386097 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:24.386056 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" event={"ID":"90901083-e78b-4310-99f1-5f7f6e66e940","Type":"ContainerStarted","Data":"7c47d8a170882b9858a2edd8c59020a26fb1aece05bea8927d384c1d4cdf4ee7"} May 21 14:42:26.395009 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:26.394971 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" event={"ID":"90901083-e78b-4310-99f1-5f7f6e66e940","Type":"ContainerStarted","Data":"b3db3b8a6d4d6253d3fe496c8382e889e8128722f65af0edf82bbaf87b282da6"} May 21 14:42:26.395477 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:26.395187 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:26.399973 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:26.399950 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" May 21 14:42:26.412963 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:26.412920 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7" podStartSLOduration=3.153198526 podStartE2EDuration="4.412907219s" podCreationTimestamp="2026-05-21 14:42:22 +0000 UTC" firstStartedPulling="2026-05-21 14:42:24.015474249 +0000 UTC m=+165.685724322" lastFinishedPulling="2026-05-21 14:42:25.275182938 +0000 UTC m=+166.945433015" observedRunningTime="2026-05-21 14:42:26.411738822 +0000 UTC m=+168.081988899" watchObservedRunningTime="2026-05-21 14:42:26.412907219 +0000 UTC m=+168.083157313" May 21 14:42:27.037401 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.037359 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp"] May 21 14:42:27.039529 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.039510 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.042807 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.042708 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:42:27.042807 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.042771 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:42:27.042807 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.042798 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 14:42:27.043074 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.042863 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 14:42:27.043074 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.042771 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:42:27.043171 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.043127 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-25sxn\"" May 21 14:42:27.047850 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.047828 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp"] May 21 14:42:27.153006 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.152971 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.153006 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.153010 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db09b25a-5e0d-4da4-bb8e-47963e2a1993-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.153223 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.153030 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.153223 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.153127 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxrw\" (UniqueName: \"kubernetes.io/projected/db09b25a-5e0d-4da4-bb8e-47963e2a1993-kube-api-access-hjxrw\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.254466 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.254423 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.254466 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.254466 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db09b25a-5e0d-4da4-bb8e-47963e2a1993-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.254735 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.254487 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.254735 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:27.254618 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 14:42:27.254735 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.254627 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxrw\" (UniqueName: \"kubernetes.io/projected/db09b25a-5e0d-4da4-bb8e-47963e2a1993-kube-api-access-hjxrw\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.254735 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:27.254709 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-tls podName:db09b25a-5e0d-4da4-bb8e-47963e2a1993 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:27.754688351 +0000 UTC m=+169.424938423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-2vrxp" (UID: "db09b25a-5e0d-4da4-bb8e-47963e2a1993") : secret "prometheus-operator-tls" not found May 21 14:42:27.255159 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.255137 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db09b25a-5e0d-4da4-bb8e-47963e2a1993-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.256912 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.256895 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.266881 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.266850 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxrw\" (UniqueName: \"kubernetes.io/projected/db09b25a-5e0d-4da4-bb8e-47963e2a1993-kube-api-access-hjxrw\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.758378 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.758343 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.760706 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.760685 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db09b25a-5e0d-4da4-bb8e-47963e2a1993-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2vrxp\" (UID: \"db09b25a-5e0d-4da4-bb8e-47963e2a1993\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:27.948576 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:27.948537 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" May 21 14:42:28.075548 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:28.075516 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp"] May 21 14:42:28.078738 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:28.078713 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb09b25a_5e0d_4da4_bb8e_47963e2a1993.slice/crio-413459e95a3a542b90dd907e79f3bdb8d5271306526450dc3983bc29770a20ca WatchSource:0}: Error finding container 413459e95a3a542b90dd907e79f3bdb8d5271306526450dc3983bc29770a20ca: Status 404 returned error can't find the container with id 413459e95a3a542b90dd907e79f3bdb8d5271306526450dc3983bc29770a20ca May 21 14:42:28.401841 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:28.401758 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" event={"ID":"db09b25a-5e0d-4da4-bb8e-47963e2a1993","Type":"ContainerStarted","Data":"413459e95a3a542b90dd907e79f3bdb8d5271306526450dc3983bc29770a20ca"} May 21 14:42:28.919567 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:28.919536 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:42:29.917952 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:29.917856 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:42:29.920659 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:29.920641 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fl969\"" May 21 14:42:29.928747 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:29.928728 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmq5c" May 21 14:42:30.057386 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:30.057353 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d98097_5c36_4d83_a6f2_3b6e4242b4e5.slice/crio-cd3964c25a5cc9baf4b2a3a8d275f7e7898e21aa059205cc5a3ed670990a35dc WatchSource:0}: Error finding container cd3964c25a5cc9baf4b2a3a8d275f7e7898e21aa059205cc5a3ed670990a35dc: Status 404 returned error can't find the container with id cd3964c25a5cc9baf4b2a3a8d275f7e7898e21aa059205cc5a3ed670990a35dc May 21 14:42:30.061581 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:30.061553 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmq5c"] May 21 14:42:30.409001 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:30.408958 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmq5c" event={"ID":"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5","Type":"ContainerStarted","Data":"cd3964c25a5cc9baf4b2a3a8d275f7e7898e21aa059205cc5a3ed670990a35dc"} May 21 14:42:30.410459 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:30.410439 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" event={"ID":"db09b25a-5e0d-4da4-bb8e-47963e2a1993","Type":"ContainerStarted","Data":"27ddcccef7493511836830f001f904db799e568a7e3c1722b297c35b8403c362"} May 21 14:42:30.410577 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:30.410465 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" event={"ID":"db09b25a-5e0d-4da4-bb8e-47963e2a1993","Type":"ContainerStarted","Data":"829b19069b2bef10fbb84090a78082a1f54658a6bc08fd5aaf4b5ee5619b4eb6"} May 21 14:42:30.430833 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:30.430786 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2vrxp" podStartSLOduration=1.888955742 podStartE2EDuration="3.430773839s" podCreationTimestamp="2026-05-21 14:42:27 +0000 UTC" firstStartedPulling="2026-05-21 14:42:28.080600317 +0000 UTC m=+169.750850390" lastFinishedPulling="2026-05-21 14:42:29.622418413 +0000 UTC m=+171.292668487" observedRunningTime="2026-05-21 14:42:30.429530963 +0000 UTC m=+172.099781061" watchObservedRunningTime="2026-05-21 14:42:30.430773839 +0000 UTC m=+172.101023928" May 21 14:42:32.414066 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.414030 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bx2rw"] May 21 14:42:32.417019 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.416990 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.418006 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.417976 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmq5c" event={"ID":"f8d98097-5c36-4d83-a6f2-3b6e4242b4e5","Type":"ContainerStarted","Data":"93f9fb9161766f40b8ce2a5a794794854c35be16af7ccbbcd835386d5b907ee2"} May 21 14:42:32.419344 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.419324 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:42:32.419597 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.419572 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lkkrr\"" May 21 14:42:32.419727 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.419633 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:42:32.419727 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.419658 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:42:32.431677 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.431653 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl"] May 21 14:42:32.433906 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.433887 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.436319 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.436289 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 14:42:32.436432 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.436333 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 14:42:32.436759 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.436743 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 14:42:32.436836 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.436808 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-74c45\"" May 21 14:42:32.447893 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.447847 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl"] May 21 14:42:32.468947 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.468892 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fmq5c" podStartSLOduration=137.767818809 podStartE2EDuration="2m19.468873467s" podCreationTimestamp="2026-05-21 14:40:13 +0000 UTC" firstStartedPulling="2026-05-21 14:42:30.059193003 +0000 UTC m=+171.729443078" lastFinishedPulling="2026-05-21 14:42:31.760247664 +0000 UTC m=+173.430497736" observedRunningTime="2026-05-21 14:42:32.467670283 +0000 UTC m=+174.137920377" watchObservedRunningTime="2026-05-21 14:42:32.468873467 +0000 UTC m=+174.139123560" May 21 14:42:32.501084 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501040 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqgp\" (UniqueName: \"kubernetes.io/projected/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-api-access-pwqgp\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.501325 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501099 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.501325 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501128 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.501325 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.501325 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-tls\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501325 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501241 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-root\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501325 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-textfile\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501363 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fdedf19-27f4-4145-8622-4bcfaf953944-metrics-client-ca\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxdrs\" (UniqueName: \"kubernetes.io/projected/0fdedf19-27f4-4145-8622-4bcfaf953944-kube-api-access-lxdrs\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501428 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-wtmp\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501535 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501582 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-sys\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.501612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501610 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.501906 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.501645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-accelerators-collector-config\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602423 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602371 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.602423 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602424 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-tls\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602467 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-root\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602512 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-textfile\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602561 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602586 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fdedf19-27f4-4145-8622-4bcfaf953944-metrics-client-ca\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602607 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxdrs\" (UniqueName: \"kubernetes.io/projected/0fdedf19-27f4-4145-8622-4bcfaf953944-kube-api-access-lxdrs\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:32.602612 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 14:42:32.602686 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602637 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-wtmp\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602687 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602720 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-sys\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602749 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602780 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-accelerators-collector-config\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602806 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqgp\" (UniqueName: \"kubernetes.io/projected/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-api-access-pwqgp\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602831 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602855 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.603017 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.602859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.603372 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.603318 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-wtmp\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.603528 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:32.603509 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-tls podName:0fdedf19-27f4-4145-8622-4bcfaf953944 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.103466315 +0000 UTC m=+174.773716404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-tls") pod "node-exporter-bx2rw" (UID: "0fdedf19-27f4-4145-8622-4bcfaf953944") : secret "node-exporter-tls" not found May 21 14:42:32.604048 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.604025 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-accelerators-collector-config\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.604172 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.603832 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fdedf19-27f4-4145-8622-4bcfaf953944-metrics-client-ca\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.604172 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.603867 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-root\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.604328 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.603895 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fdedf19-27f4-4145-8622-4bcfaf953944-sys\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.604328 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.603998 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.604328 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.604012 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-textfile\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.604328 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.603806 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.604328 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:32.603871 2553 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 21 14:42:32.604328 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:42:32.604282 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-tls podName:5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.104264987 +0000 UTC m=+174.774515065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-vqghl" (UID: "5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d") : secret "kube-state-metrics-tls" not found May 21 14:42:32.606369 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.606349 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:32.606572 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.606550 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.614725 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.614689 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqgp\" (UniqueName: \"kubernetes.io/projected/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-api-access-pwqgp\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:32.615188 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:32.615147 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxdrs\" (UniqueName: \"kubernetes.io/projected/0fdedf19-27f4-4145-8622-4bcfaf953944-kube-api-access-lxdrs\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:33.107232 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.107187 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-tls\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:33.107573 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.107297 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:33.109587 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.109565 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fdedf19-27f4-4145-8622-4bcfaf953944-node-exporter-tls\") pod \"node-exporter-bx2rw\" (UID: \"0fdedf19-27f4-4145-8622-4bcfaf953944\") " pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:33.109723 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.109704 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vqghl\" (UID: \"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:33.327618 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.327573 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bx2rw" May 21 14:42:33.335853 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:33.335823 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdedf19_27f4_4145_8622_4bcfaf953944.slice/crio-c9c6bde52e67e726c7a6dc5542c00d2550e066bc49afa4e7f358226574418d6b WatchSource:0}: Error finding container c9c6bde52e67e726c7a6dc5542c00d2550e066bc49afa4e7f358226574418d6b: Status 404 returned error can't find the container with id c9c6bde52e67e726c7a6dc5542c00d2550e066bc49afa4e7f358226574418d6b May 21 14:42:33.348380 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.348356 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" May 21 14:42:33.388570 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.388360 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7qrnt" May 21 14:42:33.424467 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.424430 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bx2rw" event={"ID":"0fdedf19-27f4-4145-8622-4bcfaf953944","Type":"ContainerStarted","Data":"c9c6bde52e67e726c7a6dc5542c00d2550e066bc49afa4e7f358226574418d6b"} May 21 14:42:33.491624 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.491595 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl"] May 21 14:42:33.494297 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:33.494269 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe8e8cb_2ad7_46dd_a90e_7fb30a8bda5d.slice/crio-68ffdf6171dc0c79d5168f26898dfde5e6bf401b8897e360a6734eddde70a5a0 WatchSource:0}: Error finding container 68ffdf6171dc0c79d5168f26898dfde5e6bf401b8897e360a6734eddde70a5a0: Status 404 returned error can't find the container with id 68ffdf6171dc0c79d5168f26898dfde5e6bf401b8897e360a6734eddde70a5a0 May 21 14:42:33.511378 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.511347 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 14:42:33.515473 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.515451 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.518030 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.517999 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 14:42:33.518030 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518018 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 14:42:33.518189 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518038 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 14:42:33.518189 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.517999 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 14:42:33.518374 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518358 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 14:42:33.518374 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518367 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 14:42:33.518503 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518375 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 14:42:33.518503 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518401 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 14:42:33.518722 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518706 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 14:42:33.518800 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.518709 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z7r2s\"" May 21 14:42:33.527215 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.527168 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 14:42:33.611755 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611724 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.611755 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611757 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e207c4-0b80-4571-848f-b7bb5d329db3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612036 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611783 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612036 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611881 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e207c4-0b80-4571-848f-b7bb5d329db3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612036 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611921 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09e207c4-0b80-4571-848f-b7bb5d329db3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612036 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611956 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612036 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.611996 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-web-config\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612193 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.612063 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bnnn\" (UniqueName: \"kubernetes.io/projected/09e207c4-0b80-4571-848f-b7bb5d329db3-kube-api-access-4bnnn\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612193 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.612098 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09e207c4-0b80-4571-848f-b7bb5d329db3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612193 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.612122 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09e207c4-0b80-4571-848f-b7bb5d329db3-config-out\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612193 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.612148 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612193 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.612181 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.612347 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.612217 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-config-volume\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712650 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712559 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712650 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712596 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-config-volume\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712650 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712617 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712928 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712737 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e207c4-0b80-4571-848f-b7bb5d329db3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712928 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712785 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712928 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712848 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e207c4-0b80-4571-848f-b7bb5d329db3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.712928 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712886 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09e207c4-0b80-4571-848f-b7bb5d329db3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713115 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712934 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713115 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.712994 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-web-config\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713115 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.713041 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bnnn\" (UniqueName: \"kubernetes.io/projected/09e207c4-0b80-4571-848f-b7bb5d329db3-kube-api-access-4bnnn\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713115 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.713092 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09e207c4-0b80-4571-848f-b7bb5d329db3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713305 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.713120 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09e207c4-0b80-4571-848f-b7bb5d329db3-config-out\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713305 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.713165 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.713421 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.713389 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09e207c4-0b80-4571-848f-b7bb5d329db3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.714542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.714203 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e207c4-0b80-4571-848f-b7bb5d329db3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.714542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.714320 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e207c4-0b80-4571-848f-b7bb5d329db3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.716244 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716191 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.716244 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716217 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.716430 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716402 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.716722 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716674 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.716722 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716700 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.716985 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716969 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09e207c4-0b80-4571-848f-b7bb5d329db3-config-out\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.717039 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.716970 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09e207c4-0b80-4571-848f-b7bb5d329db3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.717286 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.717263 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-config-volume\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.717483 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.717459 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09e207c4-0b80-4571-848f-b7bb5d329db3-web-config\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.721726 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.721708 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bnnn\" (UniqueName: \"kubernetes.io/projected/09e207c4-0b80-4571-848f-b7bb5d329db3-kube-api-access-4bnnn\") pod \"alertmanager-main-0\" (UID: \"09e207c4-0b80-4571-848f-b7bb5d329db3\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.828256 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.828221 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 14:42:33.986440 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:33.986396 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 14:42:33.988645 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:33.988618 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e207c4_0b80_4571_848f_b7bb5d329db3.slice/crio-44356a73946208ef483cd9dc4fd1240d60cbd650298ea634187ff8ede9c455c9 WatchSource:0}: Error finding container 44356a73946208ef483cd9dc4fd1240d60cbd650298ea634187ff8ede9c455c9: Status 404 returned error can't find the container with id 44356a73946208ef483cd9dc4fd1240d60cbd650298ea634187ff8ede9c455c9 May 21 14:42:34.406642 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.406606 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f5bd569f8-q88g8"] May 21 14:42:34.409625 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.409601 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.412154 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412128 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4frr60icvddvi\"" May 21 14:42:34.412308 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412139 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 14:42:34.412625 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412574 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 14:42:34.412737 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412626 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 14:42:34.412737 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412642 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 14:42:34.412737 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412672 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 14:42:34.412893 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.412805 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5zsgl\"" May 21 14:42:34.421552 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.421520 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f5bd569f8-q88g8"] May 21 14:42:34.429544 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.429461 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" event={"ID":"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d","Type":"ContainerStarted","Data":"68ffdf6171dc0c79d5168f26898dfde5e6bf401b8897e360a6734eddde70a5a0"} May 21 14:42:34.430873 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.430827 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"44356a73946208ef483cd9dc4fd1240d60cbd650298ea634187ff8ede9c455c9"} May 21 14:42:34.432637 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.432603 2553 generic.go:358] "Generic (PLEG): container finished" podID="0fdedf19-27f4-4145-8622-4bcfaf953944" containerID="5db9aeaa8c9aaba5f8f14e0a6ed0e5b702765d4224c9d4954b727e6eef49f1a6" exitCode=0 May 21 14:42:34.432763 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.432641 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bx2rw" event={"ID":"0fdedf19-27f4-4145-8622-4bcfaf953944","Type":"ContainerDied","Data":"5db9aeaa8c9aaba5f8f14e0a6ed0e5b702765d4224c9d4954b727e6eef49f1a6"} May 21 14:42:34.519823 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.519788 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.519943 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.519858 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-grpc-tls\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.519943 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.519885 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w54f8\" (UniqueName: \"kubernetes.io/projected/a6780de4-81d6-43b7-918e-e6cad6d1ca11-kube-api-access-w54f8\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.519943 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.519915 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.520083 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.519941 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.520083 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.520047 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-tls\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.520170 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.520092 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.520458 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.520297 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6780de4-81d6-43b7-918e-e6cad6d1ca11-metrics-client-ca\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621681 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621645 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-tls\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621681 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621680 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621737 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6780de4-81d6-43b7-918e-e6cad6d1ca11-metrics-client-ca\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621766 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621789 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-grpc-tls\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621812 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w54f8\" (UniqueName: \"kubernetes.io/projected/a6780de4-81d6-43b7-918e-e6cad6d1ca11-kube-api-access-w54f8\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621840 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.621930 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.621865 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.622726 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.622697 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6780de4-81d6-43b7-918e-e6cad6d1ca11-metrics-client-ca\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.624456 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.624430 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-tls\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.624956 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.624930 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.625059 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.625031 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.625121 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.625062 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-grpc-tls\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.625176 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.625118 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.625243 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.625211 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6780de4-81d6-43b7-918e-e6cad6d1ca11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.630585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.630560 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w54f8\" (UniqueName: \"kubernetes.io/projected/a6780de4-81d6-43b7-918e-e6cad6d1ca11-kube-api-access-w54f8\") pod \"thanos-querier-f5bd569f8-q88g8\" (UID: \"a6780de4-81d6-43b7-918e-e6cad6d1ca11\") " pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.740801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.740571 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:34.924738 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:34.924689 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f5bd569f8-q88g8"] May 21 14:42:35.158905 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:42:35.158819 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6780de4_81d6_43b7_918e_e6cad6d1ca11.slice/crio-065f73b7abb479a8418d78d86f27257c0ffc71d39d03a4e45f49538e2e5fb04b WatchSource:0}: Error finding container 065f73b7abb479a8418d78d86f27257c0ffc71d39d03a4e45f49538e2e5fb04b: Status 404 returned error can't find the container with id 065f73b7abb479a8418d78d86f27257c0ffc71d39d03a4e45f49538e2e5fb04b May 21 14:42:35.439092 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:35.439057 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"065f73b7abb479a8418d78d86f27257c0ffc71d39d03a4e45f49538e2e5fb04b"} May 21 14:42:35.441049 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:35.441012 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bx2rw" event={"ID":"0fdedf19-27f4-4145-8622-4bcfaf953944","Type":"ContainerStarted","Data":"ff39ccc36f198cdf1b29b84d1b5351d04b4cdb2538cb7a9f5773746bf8a5abd0"} May 21 14:42:35.441158 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:35.441051 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bx2rw" event={"ID":"0fdedf19-27f4-4145-8622-4bcfaf953944","Type":"ContainerStarted","Data":"c0173c503147225501ca9f6d75a881bc9760563daf4d5f5193af8a8142f53107"} May 21 14:42:35.460409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:35.460355 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bx2rw" podStartSLOduration=2.57551772 podStartE2EDuration="3.460337984s" podCreationTimestamp="2026-05-21 14:42:32 +0000 UTC" firstStartedPulling="2026-05-21 14:42:33.337443048 +0000 UTC m=+175.007693120" lastFinishedPulling="2026-05-21 14:42:34.222263301 +0000 UTC m=+175.892513384" observedRunningTime="2026-05-21 14:42:35.45962618 +0000 UTC m=+177.129876275" watchObservedRunningTime="2026-05-21 14:42:35.460337984 +0000 UTC m=+177.130588080" May 21 14:42:36.446309 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:36.446273 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" event={"ID":"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d","Type":"ContainerStarted","Data":"bbc64d2fec769e9f1ca6be87b1b06ff7884df6df52a8a871e3238f2291ce005a"} May 21 14:42:36.446309 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:36.446313 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" event={"ID":"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d","Type":"ContainerStarted","Data":"872025642a75e00ecf4c325f7d4349e0ab47e708b84a68ee359abfd8d4224cc7"} May 21 14:42:36.446309 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:36.446324 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" event={"ID":"5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d","Type":"ContainerStarted","Data":"ed0ffee728ad08f8661d4b186488ad44ba0645c27d1c12f1cb30f21f8864d1d8"} May 21 14:42:36.448122 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:36.448079 2553 generic.go:358] "Generic (PLEG): container finished" podID="09e207c4-0b80-4571-848f-b7bb5d329db3" containerID="0bf26d123aad58a37adaece3ea7bb6c180736142ce58462e20b314974807f74c" exitCode=0 May 21 14:42:36.448247 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:36.448165 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerDied","Data":"0bf26d123aad58a37adaece3ea7bb6c180736142ce58462e20b314974807f74c"} May 21 14:42:36.472612 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:36.472561 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vqghl" podStartSLOduration=2.5364090299999997 podStartE2EDuration="4.472540713s" podCreationTimestamp="2026-05-21 14:42:32 +0000 UTC" firstStartedPulling="2026-05-21 14:42:33.496284871 +0000 UTC m=+175.166534944" lastFinishedPulling="2026-05-21 14:42:35.432416555 +0000 UTC m=+177.102666627" observedRunningTime="2026-05-21 14:42:36.470991778 +0000 UTC m=+178.141241897" watchObservedRunningTime="2026-05-21 14:42:36.472540713 +0000 UTC m=+178.142790847" May 21 14:42:37.452830 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:37.452730 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"dcf3e2937c18f2eaf8b9f244bc49069457368b1143605635f6e37ee5a23d6f9a"} May 21 14:42:37.452830 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:37.452772 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"356ecc8d189eacb711038b04c2f7491ac5862f69da0bb739e9443d2028f2a709"} May 21 14:42:37.452830 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:37.452781 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"b2f6823db926888ad834fc2f46a3dd8c856287489d8b880cd12f59cef0402af0"} May 21 14:42:38.462804 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.462720 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"e1b9c2c84ff6768d78b61ab7cec5bbc5fdc39e5abc04244fdaa72163fa81a876"} May 21 14:42:38.462804 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.462771 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"35dce78a5575fb9827b6f949100fccad6f8ad13ccdf61fccd7465da8b9c60213"} May 21 14:42:38.462804 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.462786 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" event={"ID":"a6780de4-81d6-43b7-918e-e6cad6d1ca11","Type":"ContainerStarted","Data":"8581165abce07a2f7e3ea6f75e0ee3c8f611be0d6bea7cd3564d8958c85b01d1"} May 21 14:42:38.463331 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.462880 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:38.466343 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.466198 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"de99a3dd9cb274812aaa542b15fc71c2d561e61e386a4dd8d9ba1cd74e789d8e"} May 21 14:42:38.466343 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.466234 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"b41a63cde2ab858c8e9faaa050eae9e5c42c59852c7fcbf6560f6da0ff92784d"} May 21 14:42:38.466343 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.466249 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"8204f3b12b0029b1534673870f203993482668bf23cea99c9a055fdd96acdc49"} May 21 14:42:38.491466 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.491408 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" podStartSLOduration=1.441820415 podStartE2EDuration="4.491386989s" podCreationTimestamp="2026-05-21 14:42:34 +0000 UTC" firstStartedPulling="2026-05-21 14:42:35.161066606 +0000 UTC m=+176.831316680" lastFinishedPulling="2026-05-21 14:42:38.210633175 +0000 UTC m=+179.880883254" observedRunningTime="2026-05-21 14:42:38.488202775 +0000 UTC m=+180.158452874" watchObservedRunningTime="2026-05-21 14:42:38.491386989 +0000 UTC m=+180.161637085" May 21 14:42:38.712786 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.712745 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:42:38.716636 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.716563 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.719773 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.719749 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:42:38.719948 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.719801 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:42:38.719948 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.719888 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:42:38.719948 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.719801 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbb97\"" May 21 14:42:38.720528 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.720506 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:42:38.721035 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.721009 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:42:38.721132 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.721013 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:42:38.724606 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.724583 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:42:38.726452 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.724967 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:42:38.726452 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.726313 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 14:42:38.726959 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.726936 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-43mjd84sg8v3b\"" May 21 14:42:38.728107 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.728051 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:42:38.728326 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.728277 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:42:38.732402 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.731602 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:42:38.733438 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.733419 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:42:38.733764 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.733737 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:42:38.865039 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.864995 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865196 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865077 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865196 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865196 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865169 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-config\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865388 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865246 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwsj7\" (UniqueName: \"kubernetes.io/projected/8832b9b0-0454-43ba-9243-26db94f06a28-kube-api-access-dwsj7\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865388 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865282 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865388 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865388 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865339 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865388 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865444 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8832b9b0-0454-43ba-9243-26db94f06a28-config-out\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865531 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8832b9b0-0454-43ba-9243-26db94f06a28-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865559 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865603 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865648 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-web-config\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865703 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.865889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.865727 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966336 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966302 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966354 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-web-config\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966383 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966401 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966427 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966458 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966849 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966654 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966849 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966714 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-config\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.966849 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966819 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwsj7\" (UniqueName: \"kubernetes.io/projected/8832b9b0-0454-43ba-9243-26db94f06a28-kube-api-access-dwsj7\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967001 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966871 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967001 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.966970 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967100 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967006 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967100 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967039 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967100 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967091 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8832b9b0-0454-43ba-9243-26db94f06a28-config-out\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967243 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967117 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967243 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967149 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8832b9b0-0454-43ba-9243-26db94f06a28-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967243 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967176 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967380 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967367 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967436 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967393 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.967579 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.967556 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.969522 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.968859 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:42:38.969522 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.969195 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:42:38.969522 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.969384 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:42:38.969729 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.969585 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:42:38.970081 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970060 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 14:42:38.970291 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970271 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:42:38.970344 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970318 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:42:38.971220 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970271 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:42:38.971220 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970520 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:42:38.971220 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970802 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:42:38.971220 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.970949 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-43mjd84sg8v3b\"" May 21 14:42:38.971220 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.971055 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:42:38.971881 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.971855 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8832b9b0-0454-43ba-9243-26db94f06a28-config-out\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.972819 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.972789 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:42:38.978914 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.978883 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.979068 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.979048 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.980130 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.979682 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:42:38.981780 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.980896 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.981780 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.981513 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwsj7\" (UniqueName: \"kubernetes.io/projected/8832b9b0-0454-43ba-9243-26db94f06a28-kube-api-access-dwsj7\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.984343 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.984322 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8832b9b0-0454-43ba-9243-26db94f06a28-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.985273 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.984962 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.985840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.985482 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.985840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.985562 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.985840 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.985794 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.986056 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.986034 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.986321 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.986278 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-config\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.986570 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.986551 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-web-config\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.987228 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.987205 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.987317 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.987270 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8832b9b0-0454-43ba-9243-26db94f06a28-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:38.987542 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:38.987518 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8832b9b0-0454-43ba-9243-26db94f06a28-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8832b9b0-0454-43ba-9243-26db94f06a28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:39.038719 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.038685 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbb97\"" May 21 14:42:39.046758 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.046732 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:39.190820 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.189507 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:42:39.471418 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.471383 2553 generic.go:358] "Generic (PLEG): container finished" podID="8832b9b0-0454-43ba-9243-26db94f06a28" containerID="125f726971947eb260f8e53f54343aa3e7bde19eb1a7c32161d5805f87cf2565" exitCode=0 May 21 14:42:39.471908 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.471473 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerDied","Data":"125f726971947eb260f8e53f54343aa3e7bde19eb1a7c32161d5805f87cf2565"} May 21 14:42:39.471908 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.471547 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"6688111e7c267e57090435c5e3498b160c6b2538099daea3cdd5deff5add18c4"} May 21 14:42:39.474480 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.474454 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"b8b76c2fcab2a6c93a15fab8faa625a39a7dc6c9c3b601761db0dbd68e1f0e5b"} May 21 14:42:39.474595 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.474511 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"d1bc21160816ee2c09244cccdde7bec718ce762e86a0aaab4ac4aa3985b22fd0"} May 21 14:42:39.474595 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.474527 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09e207c4-0b80-4571-848f-b7bb5d329db3","Type":"ContainerStarted","Data":"a5f415ff3ce1943f515564795679c13773e55232818b52d68f933bc2af175fc9"} May 21 14:42:39.535585 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:39.535531 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.314816194 podStartE2EDuration="6.535516808s" podCreationTimestamp="2026-05-21 14:42:33 +0000 UTC" firstStartedPulling="2026-05-21 14:42:33.990566665 +0000 UTC m=+175.660816748" lastFinishedPulling="2026-05-21 14:42:38.211267275 +0000 UTC m=+179.881517362" observedRunningTime="2026-05-21 14:42:39.533650414 +0000 UTC m=+181.203900509" watchObservedRunningTime="2026-05-21 14:42:39.535516808 +0000 UTC m=+181.205766898" May 21 14:42:43.493338 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:43.493302 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"76ff68ee228930c6252d3828e643a99c7017d98527ac4492f40b79d67d1597ae"} May 21 14:42:43.493766 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:43.493347 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"40cb9f5c34562a76605d857bfa056c26cb8624164975dfffdc8df188b6ca6df3"} May 21 14:42:43.493766 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:43.493365 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"7b9cd3ea5d9dc0614eb0a7bc4b93ec51163ef335c13864de4d75aff1fd41506f"} May 21 14:42:43.493766 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:43.493379 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"bc033c947410bd70cabf9aebbf5ad35fa09fbd147b4ef38bb4b2b69602d0135c"} May 21 14:42:43.493766 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:43.493392 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"ddc17266967f0c72cc29a9b13aa757f9d8663e4d844a486aefe806d2ace7cf2b"} May 21 14:42:43.493766 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:43.493404 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8832b9b0-0454-43ba-9243-26db94f06a28","Type":"ContainerStarted","Data":"139a60bd28dfbb311456fe05ba0a95ba78b324a56f04db9f2149d7c194400c9c"} May 21 14:42:44.047079 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:44.047039 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:42:44.480822 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:44.480745 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f5bd569f8-q88g8" May 21 14:42:44.507607 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:42:44.507553 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.304318864 podStartE2EDuration="6.507537349s" podCreationTimestamp="2026-05-21 14:42:38 +0000 UTC" firstStartedPulling="2026-05-21 14:42:39.472865599 +0000 UTC m=+181.143115684" lastFinishedPulling="2026-05-21 14:42:42.676084076 +0000 UTC m=+184.346334169" observedRunningTime="2026-05-21 14:42:43.534347159 +0000 UTC m=+185.204597254" watchObservedRunningTime="2026-05-21 14:42:44.507537349 +0000 UTC m=+186.177787443" May 21 14:43:11.578477 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:11.578439 2553 generic.go:358] "Generic (PLEG): container finished" podID="626a8ad3-e045-40c3-9d40-ac19a64e123f" containerID="ce2bea2f7352f9d36f2a2f9878e8ee2461e025960d30897bee57457951e26416" exitCode=0 May 21 14:43:11.578918 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:11.578521 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" event={"ID":"626a8ad3-e045-40c3-9d40-ac19a64e123f","Type":"ContainerDied","Data":"ce2bea2f7352f9d36f2a2f9878e8ee2461e025960d30897bee57457951e26416"} May 21 14:43:11.578918 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:11.578899 2553 scope.go:117] "RemoveContainer" containerID="ce2bea2f7352f9d36f2a2f9878e8ee2461e025960d30897bee57457951e26416" May 21 14:43:12.583633 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:12.583589 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-49jgq" event={"ID":"626a8ad3-e045-40c3-9d40-ac19a64e123f","Type":"ContainerStarted","Data":"f8140081488c121f7cfa86269a59ef1947e7014397d3709b31cbc51629bc3518"} May 21 14:43:39.047301 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:39.047264 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:43:39.063267 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:39.063238 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:43:39.681271 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:39.681242 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:43:50.725572 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:50.725533 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:43:50.727905 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:50.727885 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ff1ed8-1a76-4f9f-a243-8a159873b6ab-metrics-certs\") pod \"network-metrics-daemon-2lsrm\" (UID: \"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab\") " pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:43:50.823303 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:50.823263 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qcw62\"" May 21 14:43:50.831326 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:50.831299 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lsrm" May 21 14:43:50.960580 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:50.960554 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lsrm"] May 21 14:43:50.963260 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:43:50.963230 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ff1ed8_1a76_4f9f_a243_8a159873b6ab.slice/crio-0bc91b7871524f11626185814e18faba33cc71df4c83511a45c4f517ed21be4c WatchSource:0}: Error finding container 0bc91b7871524f11626185814e18faba33cc71df4c83511a45c4f517ed21be4c: Status 404 returned error can't find the container with id 0bc91b7871524f11626185814e18faba33cc71df4c83511a45c4f517ed21be4c May 21 14:43:51.704605 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:51.704565 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lsrm" event={"ID":"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab","Type":"ContainerStarted","Data":"0bc91b7871524f11626185814e18faba33cc71df4c83511a45c4f517ed21be4c"} May 21 14:43:52.709214 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:52.709171 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lsrm" event={"ID":"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab","Type":"ContainerStarted","Data":"ea953feb689459e377e7e75ae50135c9a573914dcd91e2de237c588a3f2ec88c"} May 21 14:43:52.709214 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:52.709213 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lsrm" event={"ID":"f0ff1ed8-1a76-4f9f-a243-8a159873b6ab","Type":"ContainerStarted","Data":"8ad16c35f611735f72fa9b96e37c993a30373ed856c547407119fb0d67e91abe"} May 21 14:43:52.729745 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:43:52.729695 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2lsrm" podStartSLOduration=253.657612516 podStartE2EDuration="4m14.729679119s" podCreationTimestamp="2026-05-21 14:39:38 +0000 UTC" firstStartedPulling="2026-05-21 14:43:50.964946977 +0000 UTC m=+252.635197050" lastFinishedPulling="2026-05-21 14:43:52.037013573 +0000 UTC m=+253.707263653" observedRunningTime="2026-05-21 14:43:52.728067179 +0000 UTC m=+254.398317275" watchObservedRunningTime="2026-05-21 14:43:52.729679119 +0000 UTC m=+254.399929231" May 21 14:44:38.804451 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:44:38.804421 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:44:38.805517 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:44:38.805479 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:44:38.814212 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:44:38.814193 2553 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:45:59.566979 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.566905 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv"] May 21 14:45:59.570163 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.570144 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.576717 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.576539 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:45:59.576838 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.576810 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k6rsz\"" May 21 14:45:59.576963 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.576914 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:45:59.576963 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.576924 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:45:59.577309 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.577290 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:45:59.615238 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.615199 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv"] May 21 14:45:59.664853 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.664815 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/966c4ec9-e164-4b93-825a-bf061cf6b6bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.664853 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.664857 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966c4ec9-e164-4b93-825a-bf061cf6b6bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.665079 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.664881 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jtx\" (UniqueName: \"kubernetes.io/projected/966c4ec9-e164-4b93-825a-bf061cf6b6bb-kube-api-access-b8jtx\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.765900 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.765863 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/966c4ec9-e164-4b93-825a-bf061cf6b6bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.766105 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.765923 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966c4ec9-e164-4b93-825a-bf061cf6b6bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.766105 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.766051 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jtx\" (UniqueName: \"kubernetes.io/projected/966c4ec9-e164-4b93-825a-bf061cf6b6bb-kube-api-access-b8jtx\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.768517 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.768466 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966c4ec9-e164-4b93-825a-bf061cf6b6bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.768636 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.768614 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/966c4ec9-e164-4b93-825a-bf061cf6b6bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.783318 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.783289 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jtx\" (UniqueName: \"kubernetes.io/projected/966c4ec9-e164-4b93-825a-bf061cf6b6bb-kube-api-access-b8jtx\") pod \"opendatahub-operator-controller-manager-86bf5b4865-vwsrv\" (UID: \"966c4ec9-e164-4b93-825a-bf061cf6b6bb\") " pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:45:59.879994 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:45:59.879906 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:46:00.018373 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:00.018346 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv"] May 21 14:46:00.020443 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:46:00.020414 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966c4ec9_e164_4b93_825a_bf061cf6b6bb.slice/crio-71d922b785f7e26e6b9eb19ff258333812c7b737093782be3870b28a4834333f WatchSource:0}: Error finding container 71d922b785f7e26e6b9eb19ff258333812c7b737093782be3870b28a4834333f: Status 404 returned error can't find the container with id 71d922b785f7e26e6b9eb19ff258333812c7b737093782be3870b28a4834333f May 21 14:46:00.022083 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:00.022066 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:46:00.088505 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:00.088457 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" event={"ID":"966c4ec9-e164-4b93-825a-bf061cf6b6bb","Type":"ContainerStarted","Data":"71d922b785f7e26e6b9eb19ff258333812c7b737093782be3870b28a4834333f"} May 21 14:46:03.101089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:03.101051 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" event={"ID":"966c4ec9-e164-4b93-825a-bf061cf6b6bb","Type":"ContainerStarted","Data":"a9894db0213d3ec9900b4bbc6e8016c7e0380383df59fa4114ca7cd2b680405c"} May 21 14:46:03.101472 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:03.101139 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:46:03.134507 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:03.134445 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" podStartSLOduration=1.676432425 podStartE2EDuration="4.134430566s" podCreationTimestamp="2026-05-21 14:45:59 +0000 UTC" firstStartedPulling="2026-05-21 14:46:00.022187688 +0000 UTC m=+381.692437761" lastFinishedPulling="2026-05-21 14:46:02.480185827 +0000 UTC m=+384.150435902" observedRunningTime="2026-05-21 14:46:03.131883358 +0000 UTC m=+384.802133454" watchObservedRunningTime="2026-05-21 14:46:03.134430566 +0000 UTC m=+384.804680666" May 21 14:46:09.399379 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.399341 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk"] May 21 14:46:09.402788 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.402770 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.405292 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.405268 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 14:46:09.405414 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.405270 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 14:46:09.406240 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.406212 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 14:46:09.406347 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.406257 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 14:46:09.406347 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.406310 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f52pk\"" May 21 14:46:09.406484 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.406468 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 14:46:09.411597 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.411576 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk"] May 21 14:46:09.455089 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.455052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-cert\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.455283 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.455100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-metrics-cert\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.455283 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.455151 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-manager-config\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.455283 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.455202 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fngq\" (UniqueName: \"kubernetes.io/projected/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-kube-api-access-8fngq\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.556038 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.556002 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-metrics-cert\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.556195 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.556051 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-manager-config\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.556195 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.556086 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fngq\" (UniqueName: \"kubernetes.io/projected/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-kube-api-access-8fngq\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.556195 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.556130 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-cert\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.556803 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.556782 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-manager-config\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.558633 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.558609 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-cert\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.558779 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.558654 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-metrics-cert\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.566373 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.566349 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fngq\" (UniqueName: \"kubernetes.io/projected/24a64eab-57d5-466e-ae44-dbc3d3bd46c4-kube-api-access-8fngq\") pod \"lws-controller-manager-78587c7698-vmnxk\" (UID: \"24a64eab-57d5-466e-ae44-dbc3d3bd46c4\") " pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.712886 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.712785 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:09.869223 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:09.869193 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk"] May 21 14:46:09.871095 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:46:09.871067 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a64eab_57d5_466e_ae44_dbc3d3bd46c4.slice/crio-af182d5579a57815bdaf5287eb01279c965477d8e54bffc238dcfd4e5c84065d WatchSource:0}: Error finding container af182d5579a57815bdaf5287eb01279c965477d8e54bffc238dcfd4e5c84065d: Status 404 returned error can't find the container with id af182d5579a57815bdaf5287eb01279c965477d8e54bffc238dcfd4e5c84065d May 21 14:46:10.124852 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:10.124813 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" event={"ID":"24a64eab-57d5-466e-ae44-dbc3d3bd46c4","Type":"ContainerStarted","Data":"af182d5579a57815bdaf5287eb01279c965477d8e54bffc238dcfd4e5c84065d"} May 21 14:46:13.135943 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:13.135851 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" event={"ID":"24a64eab-57d5-466e-ae44-dbc3d3bd46c4","Type":"ContainerStarted","Data":"1b58d397953fc01b9b7ae245450f66f36867d92fb1904a5a3fc51c3c9a7a7f32"} May 21 14:46:13.136310 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:13.135963 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:46:13.163041 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:13.162803 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" podStartSLOduration=1.212041037 podStartE2EDuration="4.162785453s" podCreationTimestamp="2026-05-21 14:46:09 +0000 UTC" firstStartedPulling="2026-05-21 14:46:09.872898282 +0000 UTC m=+391.543148358" lastFinishedPulling="2026-05-21 14:46:12.823642697 +0000 UTC m=+394.493892774" observedRunningTime="2026-05-21 14:46:13.161350387 +0000 UTC m=+394.831600482" watchObservedRunningTime="2026-05-21 14:46:13.162785453 +0000 UTC m=+394.833035548" May 21 14:46:14.106512 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:14.106467 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bf5b4865-vwsrv" May 21 14:46:16.948600 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:16.948560 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp"] May 21 14:46:16.952337 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:16.952318 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:16.955980 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:16.955957 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 14:46:16.956568 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:16.956548 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 14:46:16.956853 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:16.956838 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-k2th7\"" May 21 14:46:16.973699 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:16.973667 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp"] May 21 14:46:17.026951 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.026916 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a162daa-4432-475a-9299-a4bd0175baca-tls-certs\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.027142 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.026971 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a162daa-4432-475a-9299-a4bd0175baca-tmp\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.027142 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.027094 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xhxk\" (UniqueName: \"kubernetes.io/projected/9a162daa-4432-475a-9299-a4bd0175baca-kube-api-access-2xhxk\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.127853 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.127817 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a162daa-4432-475a-9299-a4bd0175baca-tmp\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.128048 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.127884 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xhxk\" (UniqueName: \"kubernetes.io/projected/9a162daa-4432-475a-9299-a4bd0175baca-kube-api-access-2xhxk\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.128048 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.127923 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a162daa-4432-475a-9299-a4bd0175baca-tls-certs\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.130181 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.130155 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a162daa-4432-475a-9299-a4bd0175baca-tmp\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.130316 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.130297 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a162daa-4432-475a-9299-a4bd0175baca-tls-certs\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.149295 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.149269 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xhxk\" (UniqueName: \"kubernetes.io/projected/9a162daa-4432-475a-9299-a4bd0175baca-kube-api-access-2xhxk\") pod \"kube-auth-proxy-5f98856cd9-bt5jp\" (UID: \"9a162daa-4432-475a-9299-a4bd0175baca\") " pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.261979 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.261945 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" May 21 14:46:17.409197 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:17.409153 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp"] May 21 14:46:17.413005 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:46:17.412977 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a162daa_4432_475a_9299_a4bd0175baca.slice/crio-7050235116b509b965dc7d03f8e466ea6e0d311afd69e2c533398ea8004706a1 WatchSource:0}: Error finding container 7050235116b509b965dc7d03f8e466ea6e0d311afd69e2c533398ea8004706a1: Status 404 returned error can't find the container with id 7050235116b509b965dc7d03f8e466ea6e0d311afd69e2c533398ea8004706a1 May 21 14:46:18.154241 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:18.154203 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" event={"ID":"9a162daa-4432-475a-9299-a4bd0175baca","Type":"ContainerStarted","Data":"7050235116b509b965dc7d03f8e466ea6e0d311afd69e2c533398ea8004706a1"} May 21 14:46:20.163182 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:20.163143 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" event={"ID":"9a162daa-4432-475a-9299-a4bd0175baca","Type":"ContainerStarted","Data":"49f2be1d2d1196f83f58e4d8d4ad32b71d9dfea20d46c95507af5a724b3dfda6"} May 21 14:46:20.181341 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:20.181280 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f98856cd9-bt5jp" podStartSLOduration=1.597038794 podStartE2EDuration="4.181261963s" podCreationTimestamp="2026-05-21 14:46:16 +0000 UTC" firstStartedPulling="2026-05-21 14:46:17.414815626 +0000 UTC m=+399.085065702" lastFinishedPulling="2026-05-21 14:46:19.999038795 +0000 UTC m=+401.669288871" observedRunningTime="2026-05-21 14:46:20.180734957 +0000 UTC m=+401.850985054" watchObservedRunningTime="2026-05-21 14:46:20.181261963 +0000 UTC m=+401.851512057" May 21 14:46:24.141907 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:46:24.141873 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78587c7698-vmnxk" May 21 14:47:55.935512 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.935468 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w"] May 21 14:47:55.937730 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.937715 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:55.941757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.941738 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 14:47:55.942327 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.942312 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:47:55.942868 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.942848 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jw58q\"" May 21 14:47:55.943243 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.943226 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 14:47:55.943243 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.943235 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:47:55.957133 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:55.957112 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w"] May 21 14:47:56.015732 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.015703 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4b4c1ed0-6df1-4395-9545-1f54027a14f7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.015889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.015769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9mb\" (UniqueName: \"kubernetes.io/projected/4b4c1ed0-6df1-4395-9545-1f54027a14f7-kube-api-access-bd9mb\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.015889 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.015821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4c1ed0-6df1-4395-9545-1f54027a14f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.117236 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.117206 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9mb\" (UniqueName: \"kubernetes.io/projected/4b4c1ed0-6df1-4395-9545-1f54027a14f7-kube-api-access-bd9mb\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.117393 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.117257 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4c1ed0-6df1-4395-9545-1f54027a14f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.117393 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.117303 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4b4c1ed0-6df1-4395-9545-1f54027a14f7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.117464 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:47:56.117405 2553 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 14:47:56.117513 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:47:56.117472 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4c1ed0-6df1-4395-9545-1f54027a14f7-plugin-serving-cert podName:4b4c1ed0-6df1-4395-9545-1f54027a14f7 nodeName:}" failed. No retries permitted until 2026-05-21 14:47:56.617453459 +0000 UTC m=+498.287703539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/4b4c1ed0-6df1-4395-9545-1f54027a14f7-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-45f5w" (UID: "4b4c1ed0-6df1-4395-9545-1f54027a14f7") : secret "plugin-serving-cert" not found May 21 14:47:56.117941 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.117922 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4b4c1ed0-6df1-4395-9545-1f54027a14f7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.136610 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.136583 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9mb\" (UniqueName: \"kubernetes.io/projected/4b4c1ed0-6df1-4395-9545-1f54027a14f7-kube-api-access-bd9mb\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.623007 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.622972 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4c1ed0-6df1-4395-9545-1f54027a14f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.625471 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.625449 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b4c1ed0-6df1-4395-9545-1f54027a14f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-45f5w\" (UID: \"4b4c1ed0-6df1-4395-9545-1f54027a14f7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:56.859262 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:56.859231 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" May 21 14:47:57.008704 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:57.008681 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w"] May 21 14:47:57.011189 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:47:57.011159 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b4c1ed0_6df1_4395_9545_1f54027a14f7.slice/crio-1d37370baa455a102dfc8a22f37948ded6246384904c17acf8d42dcf4c568f86 WatchSource:0}: Error finding container 1d37370baa455a102dfc8a22f37948ded6246384904c17acf8d42dcf4c568f86: Status 404 returned error can't find the container with id 1d37370baa455a102dfc8a22f37948ded6246384904c17acf8d42dcf4c568f86 May 21 14:47:57.474696 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:47:57.474660 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" event={"ID":"4b4c1ed0-6df1-4395-9545-1f54027a14f7","Type":"ContainerStarted","Data":"1d37370baa455a102dfc8a22f37948ded6246384904c17acf8d42dcf4c568f86"} May 21 14:48:21.564507 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:21.564467 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" event={"ID":"4b4c1ed0-6df1-4395-9545-1f54027a14f7","Type":"ContainerStarted","Data":"90c1f0c9a39ccae6c453f352799935e9a2ae4e81b6389439c6eae52437920a20"} May 21 14:48:21.583143 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:21.583086 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-45f5w" podStartSLOduration=2.893345803 podStartE2EDuration="26.583072849s" podCreationTimestamp="2026-05-21 14:47:55 +0000 UTC" firstStartedPulling="2026-05-21 14:47:57.012519007 +0000 UTC m=+498.682769080" lastFinishedPulling="2026-05-21 14:48:20.70224605 +0000 UTC m=+522.372496126" observedRunningTime="2026-05-21 14:48:21.582765399 +0000 UTC m=+523.253015494" watchObservedRunningTime="2026-05-21 14:48:21.583072849 +0000 UTC m=+523.253322943" May 21 14:48:39.653599 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.653570 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:39.711269 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.711239 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:39.711456 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.711373 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:39.713814 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.713783 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 14:48:39.769124 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.769097 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:39.818792 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.818763 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwhzm\" (UniqueName: \"kubernetes.io/projected/8fa6690c-b46d-4223-80b2-7e57109958d1-kube-api-access-wwhzm\") pod \"limitador-limitador-7d549b5b-s657s\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:39.818932 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.818802 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fa6690c-b46d-4223-80b2-7e57109958d1-config-file\") pod \"limitador-limitador-7d549b5b-s657s\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:39.919526 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.919435 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwhzm\" (UniqueName: \"kubernetes.io/projected/8fa6690c-b46d-4223-80b2-7e57109958d1-kube-api-access-wwhzm\") pod \"limitador-limitador-7d549b5b-s657s\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:39.919526 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.919469 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fa6690c-b46d-4223-80b2-7e57109958d1-config-file\") pod \"limitador-limitador-7d549b5b-s657s\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:39.920125 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.920106 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fa6690c-b46d-4223-80b2-7e57109958d1-config-file\") pod \"limitador-limitador-7d549b5b-s657s\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:39.933105 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:39.933077 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwhzm\" (UniqueName: \"kubernetes.io/projected/8fa6690c-b46d-4223-80b2-7e57109958d1-kube-api-access-wwhzm\") pod \"limitador-limitador-7d549b5b-s657s\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:40.022177 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.022152 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:40.147305 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.147281 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:40.149960 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:48:40.149934 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa6690c_b46d_4223_80b2_7e57109958d1.slice/crio-e8e24190d36944a352d5d23c7a80511fe8e3bac758983e4c3c415fb40c2a776c WatchSource:0}: Error finding container e8e24190d36944a352d5d23c7a80511fe8e3bac758983e4c3c415fb40c2a776c: Status 404 returned error can't find the container with id e8e24190d36944a352d5d23c7a80511fe8e3bac758983e4c3c415fb40c2a776c May 21 14:48:40.625979 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.625920 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" event={"ID":"8fa6690c-b46d-4223-80b2-7e57109958d1","Type":"ContainerStarted","Data":"e8e24190d36944a352d5d23c7a80511fe8e3bac758983e4c3c415fb40c2a776c"} May 21 14:48:40.746470 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.746430 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-p5sbm"] May 21 14:48:40.749270 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.749250 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:48:40.752696 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.752673 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dkqlq\"" May 21 14:48:40.757906 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.757861 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-p5sbm"] May 21 14:48:40.926197 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:40.925947 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzlg\" (UniqueName: \"kubernetes.io/projected/c869848d-7e5a-4213-842a-24ef536c9278-kube-api-access-rwzlg\") pod \"authorino-7498df8756-p5sbm\" (UID: \"c869848d-7e5a-4213-842a-24ef536c9278\") " pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:48:41.027523 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:41.027148 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzlg\" (UniqueName: \"kubernetes.io/projected/c869848d-7e5a-4213-842a-24ef536c9278-kube-api-access-rwzlg\") pod \"authorino-7498df8756-p5sbm\" (UID: \"c869848d-7e5a-4213-842a-24ef536c9278\") " pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:48:41.040653 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:41.038985 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzlg\" (UniqueName: \"kubernetes.io/projected/c869848d-7e5a-4213-842a-24ef536c9278-kube-api-access-rwzlg\") pod \"authorino-7498df8756-p5sbm\" (UID: \"c869848d-7e5a-4213-842a-24ef536c9278\") " pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:48:41.062006 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:41.061578 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:48:41.213349 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:41.213256 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-p5sbm"] May 21 14:48:41.216910 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:48:41.216874 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc869848d_7e5a_4213_842a_24ef536c9278.slice/crio-b1f5d247843d825262761a191f821768bba3bf3b2ed7e54adc4edf43c2053a5e WatchSource:0}: Error finding container b1f5d247843d825262761a191f821768bba3bf3b2ed7e54adc4edf43c2053a5e: Status 404 returned error can't find the container with id b1f5d247843d825262761a191f821768bba3bf3b2ed7e54adc4edf43c2053a5e May 21 14:48:41.631432 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:41.631401 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p5sbm" event={"ID":"c869848d-7e5a-4213-842a-24ef536c9278","Type":"ContainerStarted","Data":"b1f5d247843d825262761a191f821768bba3bf3b2ed7e54adc4edf43c2053a5e"} May 21 14:48:43.644411 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:43.644370 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" event={"ID":"8fa6690c-b46d-4223-80b2-7e57109958d1","Type":"ContainerStarted","Data":"d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589"} May 21 14:48:43.644886 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:43.644525 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:43.664818 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:43.664766 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" podStartSLOduration=1.796472979 podStartE2EDuration="4.664751353s" podCreationTimestamp="2026-05-21 14:48:39 +0000 UTC" firstStartedPulling="2026-05-21 14:48:40.152001764 +0000 UTC m=+541.822251836" lastFinishedPulling="2026-05-21 14:48:43.020280134 +0000 UTC m=+544.690530210" observedRunningTime="2026-05-21 14:48:43.663459509 +0000 UTC m=+545.333709609" watchObservedRunningTime="2026-05-21 14:48:43.664751353 +0000 UTC m=+545.335001448" May 21 14:48:45.653043 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:45.653007 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p5sbm" event={"ID":"c869848d-7e5a-4213-842a-24ef536c9278","Type":"ContainerStarted","Data":"033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e"} May 21 14:48:45.670074 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:45.670029 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-p5sbm" podStartSLOduration=2.022994785 podStartE2EDuration="5.670015179s" podCreationTimestamp="2026-05-21 14:48:40 +0000 UTC" firstStartedPulling="2026-05-21 14:48:41.218431174 +0000 UTC m=+542.888681248" lastFinishedPulling="2026-05-21 14:48:44.865451566 +0000 UTC m=+546.535701642" observedRunningTime="2026-05-21 14:48:45.668660039 +0000 UTC m=+547.338910135" watchObservedRunningTime="2026-05-21 14:48:45.670015179 +0000 UTC m=+547.340265274" May 21 14:48:54.383763 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.383729 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:54.384273 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.383997 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" podUID="8fa6690c-b46d-4223-80b2-7e57109958d1" containerName="limitador" containerID="cri-o://d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589" gracePeriod=30 May 21 14:48:54.384851 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.384597 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:54.927801 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.927769 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:54.979806 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.979736 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwhzm\" (UniqueName: \"kubernetes.io/projected/8fa6690c-b46d-4223-80b2-7e57109958d1-kube-api-access-wwhzm\") pod \"8fa6690c-b46d-4223-80b2-7e57109958d1\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " May 21 14:48:54.979936 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.979813 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fa6690c-b46d-4223-80b2-7e57109958d1-config-file\") pod \"8fa6690c-b46d-4223-80b2-7e57109958d1\" (UID: \"8fa6690c-b46d-4223-80b2-7e57109958d1\") " May 21 14:48:54.980203 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.980167 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa6690c-b46d-4223-80b2-7e57109958d1-config-file" (OuterVolumeSpecName: "config-file") pod "8fa6690c-b46d-4223-80b2-7e57109958d1" (UID: "8fa6690c-b46d-4223-80b2-7e57109958d1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:48:54.980327 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.980251 2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fa6690c-b46d-4223-80b2-7e57109958d1-config-file\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 14:48:54.981993 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:54.981973 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa6690c-b46d-4223-80b2-7e57109958d1-kube-api-access-wwhzm" (OuterVolumeSpecName: "kube-api-access-wwhzm") pod "8fa6690c-b46d-4223-80b2-7e57109958d1" (UID: "8fa6690c-b46d-4223-80b2-7e57109958d1"). InnerVolumeSpecName "kube-api-access-wwhzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:48:55.081502 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.081473 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwhzm\" (UniqueName: \"kubernetes.io/projected/8fa6690c-b46d-4223-80b2-7e57109958d1-kube-api-access-wwhzm\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 14:48:55.690185 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.690150 2553 generic.go:358] "Generic (PLEG): container finished" podID="8fa6690c-b46d-4223-80b2-7e57109958d1" containerID="d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589" exitCode=0 May 21 14:48:55.690185 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.690187 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" event={"ID":"8fa6690c-b46d-4223-80b2-7e57109958d1","Type":"ContainerDied","Data":"d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589"} May 21 14:48:55.690721 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.690211 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" event={"ID":"8fa6690c-b46d-4223-80b2-7e57109958d1","Type":"ContainerDied","Data":"e8e24190d36944a352d5d23c7a80511fe8e3bac758983e4c3c415fb40c2a776c"} May 21 14:48:55.690721 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.690220 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s657s" May 21 14:48:55.690721 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.690226 2553 scope.go:117] "RemoveContainer" containerID="d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589" May 21 14:48:55.698364 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.698345 2553 scope.go:117] "RemoveContainer" containerID="d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589" May 21 14:48:55.698734 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:48:55.698711 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589\": container with ID starting with d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589 not found: ID does not exist" containerID="d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589" May 21 14:48:55.698830 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.698741 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589"} err="failed to get container status \"d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589\": rpc error: code = NotFound desc = could not find container \"d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589\": container with ID starting with d8944d0c19a11b1595982217342352b61d91aa0ad29cfcdaef96dcbcf065a589 not found: ID does not exist" May 21 14:48:55.710461 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.710439 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xx2dv"] May 21 14:48:55.710810 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.710796 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa6690c-b46d-4223-80b2-7e57109958d1" containerName="limitador" May 21 14:48:55.710852 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.710813 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa6690c-b46d-4223-80b2-7e57109958d1" containerName="limitador" May 21 14:48:55.710891 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.710882 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fa6690c-b46d-4223-80b2-7e57109958d1" containerName="limitador" May 21 14:48:55.713715 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.713697 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:55.716069 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.716046 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-r5rkv\"" May 21 14:48:55.716210 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.716053 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 14:48:55.723815 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.723768 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:55.725557 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.725540 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xx2dv"] May 21 14:48:55.727561 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.727540 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s657s"] May 21 14:48:55.788605 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.788584 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85897035-30ea-4145-a43b-9a6f7c6dec7e-data\") pod \"postgres-68c4fbbd6f-xx2dv\" (UID: \"85897035-30ea-4145-a43b-9a6f7c6dec7e\") " pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:55.788717 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.788623 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzzct\" (UniqueName: \"kubernetes.io/projected/85897035-30ea-4145-a43b-9a6f7c6dec7e-kube-api-access-vzzct\") pod \"postgres-68c4fbbd6f-xx2dv\" (UID: \"85897035-30ea-4145-a43b-9a6f7c6dec7e\") " pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:55.889596 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.889567 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85897035-30ea-4145-a43b-9a6f7c6dec7e-data\") pod \"postgres-68c4fbbd6f-xx2dv\" (UID: \"85897035-30ea-4145-a43b-9a6f7c6dec7e\") " pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:55.889708 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.889612 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzzct\" (UniqueName: \"kubernetes.io/projected/85897035-30ea-4145-a43b-9a6f7c6dec7e-kube-api-access-vzzct\") pod \"postgres-68c4fbbd6f-xx2dv\" (UID: \"85897035-30ea-4145-a43b-9a6f7c6dec7e\") " pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:55.889945 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.889928 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85897035-30ea-4145-a43b-9a6f7c6dec7e-data\") pod \"postgres-68c4fbbd6f-xx2dv\" (UID: \"85897035-30ea-4145-a43b-9a6f7c6dec7e\") " pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:55.900021 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:55.899995 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzzct\" (UniqueName: \"kubernetes.io/projected/85897035-30ea-4145-a43b-9a6f7c6dec7e-kube-api-access-vzzct\") pod \"postgres-68c4fbbd6f-xx2dv\" (UID: \"85897035-30ea-4145-a43b-9a6f7c6dec7e\") " pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:56.026176 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:56.026146 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:48:56.358730 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:56.358665 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xx2dv"] May 21 14:48:56.361390 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:48:56.361369 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85897035_30ea_4145_a43b_9a6f7c6dec7e.slice/crio-5edc50b6d966344d0e9046e80524b6487398f899f0adfd538e3201f92f23c822 WatchSource:0}: Error finding container 5edc50b6d966344d0e9046e80524b6487398f899f0adfd538e3201f92f23c822: Status 404 returned error can't find the container with id 5edc50b6d966344d0e9046e80524b6487398f899f0adfd538e3201f92f23c822 May 21 14:48:56.694309 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:56.694228 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" event={"ID":"85897035-30ea-4145-a43b-9a6f7c6dec7e","Type":"ContainerStarted","Data":"5edc50b6d966344d0e9046e80524b6487398f899f0adfd538e3201f92f23c822"} May 21 14:48:56.921848 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:48:56.921814 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa6690c-b46d-4223-80b2-7e57109958d1" path="/var/lib/kubelet/pods/8fa6690c-b46d-4223-80b2-7e57109958d1/volumes" May 21 14:49:01.715665 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:01.715626 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" event={"ID":"85897035-30ea-4145-a43b-9a6f7c6dec7e","Type":"ContainerStarted","Data":"bbaa8a0bf77f72c70aaa30527fa6da9da65e2a009444c608bc9da33a43a0acc1"} May 21 14:49:01.716056 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:01.715769 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:49:01.739786 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:01.739742 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" podStartSLOduration=1.89640206 podStartE2EDuration="6.739728392s" podCreationTimestamp="2026-05-21 14:48:55 +0000 UTC" firstStartedPulling="2026-05-21 14:48:56.362670979 +0000 UTC m=+558.032921052" lastFinishedPulling="2026-05-21 14:49:01.205997308 +0000 UTC m=+562.876247384" observedRunningTime="2026-05-21 14:49:01.738022354 +0000 UTC m=+563.408272449" watchObservedRunningTime="2026-05-21 14:49:01.739728392 +0000 UTC m=+563.409978487" May 21 14:49:07.747628 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:07.747602 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-xx2dv" May 21 14:49:08.659436 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.659399 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78877864fb-dzkqf"] May 21 14:49:08.665661 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.665631 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.667949 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.667925 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 14:49:08.671265 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.671244 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78877864fb-dzkqf"] May 21 14:49:08.809857 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.809827 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4kp5\" (UniqueName: \"kubernetes.io/projected/05705887-ac9a-454d-a57d-9c668c8b9e3c-kube-api-access-k4kp5\") pod \"authorino-78877864fb-dzkqf\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.810217 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.809960 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05705887-ac9a-454d-a57d-9c668c8b9e3c-tls-cert\") pod \"authorino-78877864fb-dzkqf\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.911034 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.910930 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05705887-ac9a-454d-a57d-9c668c8b9e3c-tls-cert\") pod \"authorino-78877864fb-dzkqf\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.911034 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.910993 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kp5\" (UniqueName: \"kubernetes.io/projected/05705887-ac9a-454d-a57d-9c668c8b9e3c-kube-api-access-k4kp5\") pod \"authorino-78877864fb-dzkqf\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.913311 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.913289 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05705887-ac9a-454d-a57d-9c668c8b9e3c-tls-cert\") pod \"authorino-78877864fb-dzkqf\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.920665 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.920631 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kp5\" (UniqueName: \"kubernetes.io/projected/05705887-ac9a-454d-a57d-9c668c8b9e3c-kube-api-access-k4kp5\") pod \"authorino-78877864fb-dzkqf\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:08.975919 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:08.975889 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:49:09.104376 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:09.104354 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78877864fb-dzkqf"] May 21 14:49:09.105822 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:49:09.105793 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05705887_ac9a_454d_a57d_9c668c8b9e3c.slice/crio-7a765edb13c4259abac2accab6000e11cef0076218bbbe1978842b1cfe532501 WatchSource:0}: Error finding container 7a765edb13c4259abac2accab6000e11cef0076218bbbe1978842b1cfe532501: Status 404 returned error can't find the container with id 7a765edb13c4259abac2accab6000e11cef0076218bbbe1978842b1cfe532501 May 21 14:49:09.744915 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:09.744881 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78877864fb-dzkqf" event={"ID":"05705887-ac9a-454d-a57d-9c668c8b9e3c","Type":"ContainerStarted","Data":"4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a"} May 21 14:49:09.745098 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:09.744922 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78877864fb-dzkqf" event={"ID":"05705887-ac9a-454d-a57d-9c668c8b9e3c","Type":"ContainerStarted","Data":"7a765edb13c4259abac2accab6000e11cef0076218bbbe1978842b1cfe532501"} May 21 14:49:09.763979 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:09.763932 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-78877864fb-dzkqf" podStartSLOduration=1.441609801 podStartE2EDuration="1.763917174s" podCreationTimestamp="2026-05-21 14:49:08 +0000 UTC" firstStartedPulling="2026-05-21 14:49:09.107104635 +0000 UTC m=+570.777354708" lastFinishedPulling="2026-05-21 14:49:09.429412008 +0000 UTC m=+571.099662081" observedRunningTime="2026-05-21 14:49:09.762353321 +0000 UTC m=+571.432603417" watchObservedRunningTime="2026-05-21 14:49:09.763917174 +0000 UTC m=+571.434167269" May 21 14:49:09.790579 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:09.790539 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-p5sbm"] May 21 14:49:09.790814 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:09.790787 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-p5sbm" podUID="c869848d-7e5a-4213-842a-24ef536c9278" containerName="authorino" containerID="cri-o://033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e" gracePeriod=30 May 21 14:49:10.029581 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.029558 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:49:10.120832 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.120717 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwzlg\" (UniqueName: \"kubernetes.io/projected/c869848d-7e5a-4213-842a-24ef536c9278-kube-api-access-rwzlg\") pod \"c869848d-7e5a-4213-842a-24ef536c9278\" (UID: \"c869848d-7e5a-4213-842a-24ef536c9278\") " May 21 14:49:10.122847 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.122819 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c869848d-7e5a-4213-842a-24ef536c9278-kube-api-access-rwzlg" (OuterVolumeSpecName: "kube-api-access-rwzlg") pod "c869848d-7e5a-4213-842a-24ef536c9278" (UID: "c869848d-7e5a-4213-842a-24ef536c9278"). InnerVolumeSpecName "kube-api-access-rwzlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:49:10.221395 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.221367 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwzlg\" (UniqueName: \"kubernetes.io/projected/c869848d-7e5a-4213-842a-24ef536c9278-kube-api-access-rwzlg\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 14:49:10.748869 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.748829 2553 generic.go:358] "Generic (PLEG): container finished" podID="c869848d-7e5a-4213-842a-24ef536c9278" containerID="033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e" exitCode=0 May 21 14:49:10.749038 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.748893 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-p5sbm" May 21 14:49:10.749038 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.748915 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p5sbm" event={"ID":"c869848d-7e5a-4213-842a-24ef536c9278","Type":"ContainerDied","Data":"033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e"} May 21 14:49:10.749038 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.748954 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-p5sbm" event={"ID":"c869848d-7e5a-4213-842a-24ef536c9278","Type":"ContainerDied","Data":"b1f5d247843d825262761a191f821768bba3bf3b2ed7e54adc4edf43c2053a5e"} May 21 14:49:10.749038 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.748970 2553 scope.go:117] "RemoveContainer" containerID="033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e" May 21 14:49:10.757187 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.757171 2553 scope.go:117] "RemoveContainer" containerID="033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e" May 21 14:49:10.757431 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:49:10.757413 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e\": container with ID starting with 033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e not found: ID does not exist" containerID="033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e" May 21 14:49:10.757506 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.757444 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e"} err="failed to get container status \"033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e\": rpc error: code = NotFound desc = could not find container \"033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e\": container with ID starting with 033bc0117f0d5dd74adaf9e71f4743d600935b8b9a01c1537ea2d9619e312a2e not found: ID does not exist" May 21 14:49:10.771159 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.771129 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-p5sbm"] May 21 14:49:10.775785 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.775764 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-p5sbm"] May 21 14:49:10.923044 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:10.923004 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c869848d-7e5a-4213-842a-24ef536c9278" path="/var/lib/kubelet/pods/c869848d-7e5a-4213-842a-24ef536c9278/volumes" May 21 14:49:27.350440 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.350405 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8mpk5"] May 21 14:49:27.351012 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.350965 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c869848d-7e5a-4213-842a-24ef536c9278" containerName="authorino" May 21 14:49:27.351012 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.350985 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c869848d-7e5a-4213-842a-24ef536c9278" containerName="authorino" May 21 14:49:27.351125 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.351112 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="c869848d-7e5a-4213-842a-24ef536c9278" containerName="authorino" May 21 14:49:27.377791 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.377765 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8mpk5"] May 21 14:49:27.377957 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.377898 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:49:27.380553 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.380527 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 14:49:27.380670 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.380577 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w9nt5\"" May 21 14:49:27.473900 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.473867 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jr9x\" (UniqueName: \"kubernetes.io/projected/1910c0c0-eb40-4582-9954-842c33f6b5df-kube-api-access-9jr9x\") pod \"maas-controller-58cbf5d79c-8mpk5\" (UID: \"1910c0c0-eb40-4582-9954-842c33f6b5df\") " pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:49:27.574428 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.574388 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jr9x\" (UniqueName: \"kubernetes.io/projected/1910c0c0-eb40-4582-9954-842c33f6b5df-kube-api-access-9jr9x\") pod \"maas-controller-58cbf5d79c-8mpk5\" (UID: \"1910c0c0-eb40-4582-9954-842c33f6b5df\") " pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:49:27.583907 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.583883 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jr9x\" (UniqueName: \"kubernetes.io/projected/1910c0c0-eb40-4582-9954-842c33f6b5df-kube-api-access-9jr9x\") pod \"maas-controller-58cbf5d79c-8mpk5\" (UID: \"1910c0c0-eb40-4582-9954-842c33f6b5df\") " pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:49:27.688409 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.688313 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:49:27.816768 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:27.816734 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8mpk5"] May 21 14:49:27.818885 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:49:27.818858 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1910c0c0_eb40_4582_9954_842c33f6b5df.slice/crio-1b7e290c6e1d874455f1581a85382d0a12a13a7bca680a0b3673c929bae75620 WatchSource:0}: Error finding container 1b7e290c6e1d874455f1581a85382d0a12a13a7bca680a0b3673c929bae75620: Status 404 returned error can't find the container with id 1b7e290c6e1d874455f1581a85382d0a12a13a7bca680a0b3673c929bae75620 May 21 14:49:28.816595 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:28.816550 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" event={"ID":"1910c0c0-eb40-4582-9954-842c33f6b5df","Type":"ContainerStarted","Data":"1b7e290c6e1d874455f1581a85382d0a12a13a7bca680a0b3673c929bae75620"} May 21 14:49:30.826359 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:30.826324 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" event={"ID":"1910c0c0-eb40-4582-9954-842c33f6b5df","Type":"ContainerStarted","Data":"0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783"} May 21 14:49:30.826835 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:30.826449 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:49:30.847842 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:30.847796 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" podStartSLOduration=1.654483962 podStartE2EDuration="3.847772377s" podCreationTimestamp="2026-05-21 14:49:27 +0000 UTC" firstStartedPulling="2026-05-21 14:49:27.820151936 +0000 UTC m=+589.490402009" lastFinishedPulling="2026-05-21 14:49:30.013440329 +0000 UTC m=+591.683690424" observedRunningTime="2026-05-21 14:49:30.845978284 +0000 UTC m=+592.516228379" watchObservedRunningTime="2026-05-21 14:49:30.847772377 +0000 UTC m=+592.518022473" May 21 14:49:38.840220 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:38.840198 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:49:38.841505 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:38.841473 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:49:41.836208 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:49:41.836179 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:50:20.142614 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.142567 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb"] May 21 14:50:20.150196 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.150156 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.159898 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.159873 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w88nz\"" May 21 14:50:20.160258 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.160235 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 14:50:20.160788 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.160773 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 14:50:20.160845 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.160796 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 14:50:20.191000 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.190965 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb"] May 21 14:50:20.234985 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.234950 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.234985 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.234988 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjwp\" (UniqueName: \"kubernetes.io/projected/f3aba338-58c7-49af-bae3-e1d6399b5fe3-kube-api-access-czjwp\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.235188 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.235011 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3aba338-58c7-49af-bae3-e1d6399b5fe3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.235188 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.235125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.235258 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.235192 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.235258 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.235243 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336460 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336420 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336460 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336467 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336702 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336514 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czjwp\" (UniqueName: \"kubernetes.io/projected/f3aba338-58c7-49af-bae3-e1d6399b5fe3-kube-api-access-czjwp\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336702 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336538 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3aba338-58c7-49af-bae3-e1d6399b5fe3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336702 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336580 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336835 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336812 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336940 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336919 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.336983 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.336933 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.337119 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.337102 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.338946 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.338925 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3aba338-58c7-49af-bae3-e1d6399b5fe3-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.339117 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.339101 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3aba338-58c7-49af-bae3-e1d6399b5fe3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.397315 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.397239 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjwp\" (UniqueName: \"kubernetes.io/projected/f3aba338-58c7-49af-bae3-e1d6399b5fe3-kube-api-access-czjwp\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ms4nb\" (UID: \"f3aba338-58c7-49af-bae3-e1d6399b5fe3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.460757 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.460717 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:20.636348 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.636316 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb"] May 21 14:50:20.639504 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:50:20.639467 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3aba338_58c7_49af_bae3_e1d6399b5fe3.slice/crio-fcbbb8f92d65b444a9644b9f381d9bffff234a7e736d5f05f9c799cbdf349282 WatchSource:0}: Error finding container fcbbb8f92d65b444a9644b9f381d9bffff234a7e736d5f05f9c799cbdf349282: Status 404 returned error can't find the container with id fcbbb8f92d65b444a9644b9f381d9bffff234a7e736d5f05f9c799cbdf349282 May 21 14:50:20.999127 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:20.999088 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" event={"ID":"f3aba338-58c7-49af-bae3-e1d6399b5fe3","Type":"ContainerStarted","Data":"fcbbb8f92d65b444a9644b9f381d9bffff234a7e736d5f05f9c799cbdf349282"} May 21 14:50:27.022190 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:27.022147 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" event={"ID":"f3aba338-58c7-49af-bae3-e1d6399b5fe3","Type":"ContainerStarted","Data":"f40f151f8059595fa6e55b2724dad9a6fe5f214d9f34210739de20a51d81e4af"} May 21 14:50:33.045202 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:33.045168 2553 generic.go:358] "Generic (PLEG): container finished" podID="f3aba338-58c7-49af-bae3-e1d6399b5fe3" containerID="f40f151f8059595fa6e55b2724dad9a6fe5f214d9f34210739de20a51d81e4af" exitCode=0 May 21 14:50:33.045610 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:33.045223 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" event={"ID":"f3aba338-58c7-49af-bae3-e1d6399b5fe3","Type":"ContainerDied","Data":"f40f151f8059595fa6e55b2724dad9a6fe5f214d9f34210739de20a51d81e4af"} May 21 14:50:35.055254 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:35.055220 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" event={"ID":"f3aba338-58c7-49af-bae3-e1d6399b5fe3","Type":"ContainerStarted","Data":"bf729efe8d347dada23dba0d00be678abf8a90d89ebaecd1d2411011427f5e55"} May 21 14:50:35.055718 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:35.055448 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:50:35.077420 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:35.077370 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" podStartSLOduration=1.3693288940000001 podStartE2EDuration="15.077353415s" podCreationTimestamp="2026-05-21 14:50:20 +0000 UTC" firstStartedPulling="2026-05-21 14:50:20.641070257 +0000 UTC m=+642.311320331" lastFinishedPulling="2026-05-21 14:50:34.349094776 +0000 UTC m=+656.019344852" observedRunningTime="2026-05-21 14:50:35.07476709 +0000 UTC m=+656.745017184" watchObservedRunningTime="2026-05-21 14:50:35.077353415 +0000 UTC m=+656.747603512" May 21 14:50:46.072981 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:50:46.072950 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ms4nb" May 21 14:51:51.674321 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.674238 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78877864fb-dzkqf"] May 21 14:51:51.674829 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.674467 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-78877864fb-dzkqf" podUID="05705887-ac9a-454d-a57d-9c668c8b9e3c" containerName="authorino" containerID="cri-o://4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a" gracePeriod=30 May 21 14:51:51.924708 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.924648 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:51:51.952268 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.952218 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4kp5\" (UniqueName: \"kubernetes.io/projected/05705887-ac9a-454d-a57d-9c668c8b9e3c-kube-api-access-k4kp5\") pod \"05705887-ac9a-454d-a57d-9c668c8b9e3c\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " May 21 14:51:51.952855 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.952326 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05705887-ac9a-454d-a57d-9c668c8b9e3c-tls-cert\") pod \"05705887-ac9a-454d-a57d-9c668c8b9e3c\" (UID: \"05705887-ac9a-454d-a57d-9c668c8b9e3c\") " May 21 14:51:51.954754 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.954724 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05705887-ac9a-454d-a57d-9c668c8b9e3c-kube-api-access-k4kp5" (OuterVolumeSpecName: "kube-api-access-k4kp5") pod "05705887-ac9a-454d-a57d-9c668c8b9e3c" (UID: "05705887-ac9a-454d-a57d-9c668c8b9e3c"). InnerVolumeSpecName "kube-api-access-k4kp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:51:51.966014 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:51.965986 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05705887-ac9a-454d-a57d-9c668c8b9e3c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "05705887-ac9a-454d-a57d-9c668c8b9e3c" (UID: "05705887-ac9a-454d-a57d-9c668c8b9e3c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:51:52.053650 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.053612 2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05705887-ac9a-454d-a57d-9c668c8b9e3c-tls-cert\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 14:51:52.053650 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.053645 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4kp5\" (UniqueName: \"kubernetes.io/projected/05705887-ac9a-454d-a57d-9c668c8b9e3c-kube-api-access-k4kp5\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 14:51:52.311856 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.311823 2553 generic.go:358] "Generic (PLEG): container finished" podID="05705887-ac9a-454d-a57d-9c668c8b9e3c" containerID="4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a" exitCode=0 May 21 14:51:52.312050 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.311873 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78877864fb-dzkqf" event={"ID":"05705887-ac9a-454d-a57d-9c668c8b9e3c","Type":"ContainerDied","Data":"4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a"} May 21 14:51:52.312050 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.311874 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78877864fb-dzkqf" May 21 14:51:52.312050 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.311904 2553 scope.go:117] "RemoveContainer" containerID="4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a" May 21 14:51:52.312050 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.311895 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78877864fb-dzkqf" event={"ID":"05705887-ac9a-454d-a57d-9c668c8b9e3c","Type":"ContainerDied","Data":"7a765edb13c4259abac2accab6000e11cef0076218bbbe1978842b1cfe532501"} May 21 14:51:52.321597 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.321579 2553 scope.go:117] "RemoveContainer" containerID="4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a" May 21 14:51:52.321838 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:51:52.321820 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a\": container with ID starting with 4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a not found: ID does not exist" containerID="4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a" May 21 14:51:52.321887 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.321845 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a"} err="failed to get container status \"4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a\": rpc error: code = NotFound desc = could not find container \"4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a\": container with ID starting with 4419ddef6849282f43ce585afb0d128bab0cc74ceb8d422df804098349141d6a not found: ID does not exist" May 21 14:51:52.334037 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.334015 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78877864fb-dzkqf"] May 21 14:51:52.340026 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.340006 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78877864fb-dzkqf"] May 21 14:51:52.922406 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:51:52.922370 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05705887-ac9a-454d-a57d-9c668c8b9e3c" path="/var/lib/kubelet/pods/05705887-ac9a-454d-a57d-9c668c8b9e3c/volumes" May 21 14:53:14.219986 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.219941 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8mpk5"] May 21 14:53:14.220583 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.220211 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" podUID="1910c0c0-eb40-4582-9954-842c33f6b5df" containerName="manager" containerID="cri-o://0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783" gracePeriod=30 May 21 14:53:14.462224 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.462198 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:53:14.572696 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.572665 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jr9x\" (UniqueName: \"kubernetes.io/projected/1910c0c0-eb40-4582-9954-842c33f6b5df-kube-api-access-9jr9x\") pod \"1910c0c0-eb40-4582-9954-842c33f6b5df\" (UID: \"1910c0c0-eb40-4582-9954-842c33f6b5df\") " May 21 14:53:14.574823 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.574794 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1910c0c0-eb40-4582-9954-842c33f6b5df-kube-api-access-9jr9x" (OuterVolumeSpecName: "kube-api-access-9jr9x") pod "1910c0c0-eb40-4582-9954-842c33f6b5df" (UID: "1910c0c0-eb40-4582-9954-842c33f6b5df"). InnerVolumeSpecName "kube-api-access-9jr9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:53:14.592393 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.592362 2553 generic.go:358] "Generic (PLEG): container finished" podID="1910c0c0-eb40-4582-9954-842c33f6b5df" containerID="0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783" exitCode=0 May 21 14:53:14.592504 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.592417 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" event={"ID":"1910c0c0-eb40-4582-9954-842c33f6b5df","Type":"ContainerDied","Data":"0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783"} May 21 14:53:14.592504 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.592424 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" May 21 14:53:14.592504 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.592449 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbf5d79c-8mpk5" event={"ID":"1910c0c0-eb40-4582-9954-842c33f6b5df","Type":"ContainerDied","Data":"1b7e290c6e1d874455f1581a85382d0a12a13a7bca680a0b3673c929bae75620"} May 21 14:53:14.592504 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.592469 2553 scope.go:117] "RemoveContainer" containerID="0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783" May 21 14:53:14.600402 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.600361 2553 scope.go:117] "RemoveContainer" containerID="0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783" May 21 14:53:14.600674 ip-10-0-131-210 kubenswrapper[2553]: E0521 14:53:14.600650 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783\": container with ID starting with 0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783 not found: ID does not exist" containerID="0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783" May 21 14:53:14.600737 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.600685 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783"} err="failed to get container status \"0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783\": rpc error: code = NotFound desc = could not find container \"0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783\": container with ID starting with 0a81f95cc3e3025faf9ced6fe138dc87f7df8e12e0a89a7eefbdca36752a1783 not found: ID does not exist" May 21 14:53:14.616416 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.616382 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8mpk5"] May 21 14:53:14.621440 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.621416 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8mpk5"] May 21 14:53:14.673410 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.673380 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jr9x\" (UniqueName: \"kubernetes.io/projected/1910c0c0-eb40-4582-9954-842c33f6b5df-kube-api-access-9jr9x\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 14:53:14.922180 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:14.922105 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1910c0c0-eb40-4582-9954-842c33f6b5df" path="/var/lib/kubelet/pods/1910c0c0-eb40-4582-9954-842c33f6b5df/volumes" May 21 14:53:15.379350 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379311 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8g9js"] May 21 14:53:15.379741 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379696 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05705887-ac9a-454d-a57d-9c668c8b9e3c" containerName="authorino" May 21 14:53:15.379741 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379707 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="05705887-ac9a-454d-a57d-9c668c8b9e3c" containerName="authorino" May 21 14:53:15.379741 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379724 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1910c0c0-eb40-4582-9954-842c33f6b5df" containerName="manager" May 21 14:53:15.379741 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379729 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1910c0c0-eb40-4582-9954-842c33f6b5df" containerName="manager" May 21 14:53:15.379879 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379793 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="05705887-ac9a-454d-a57d-9c668c8b9e3c" containerName="authorino" May 21 14:53:15.379879 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.379804 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="1910c0c0-eb40-4582-9954-842c33f6b5df" containerName="manager" May 21 14:53:15.384288 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.384264 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:53:15.386598 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.386578 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 14:53:15.386747 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.386731 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w9nt5\"" May 21 14:53:15.391710 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.391690 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8g9js"] May 21 14:53:15.482677 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.482645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8dxn\" (UniqueName: \"kubernetes.io/projected/e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69-kube-api-access-j8dxn\") pod \"maas-controller-58cbf5d79c-8g9js\" (UID: \"e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69\") " pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:53:15.583920 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.583888 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8dxn\" (UniqueName: \"kubernetes.io/projected/e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69-kube-api-access-j8dxn\") pod \"maas-controller-58cbf5d79c-8g9js\" (UID: \"e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69\") " pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:53:15.594741 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.594715 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8dxn\" (UniqueName: \"kubernetes.io/projected/e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69-kube-api-access-j8dxn\") pod \"maas-controller-58cbf5d79c-8g9js\" (UID: \"e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69\") " pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:53:15.695008 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.694933 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:53:15.824034 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.824007 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbf5d79c-8g9js"] May 21 14:53:15.826108 ip-10-0-131-210 kubenswrapper[2553]: W0521 14:53:15.826079 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bf13eb_36e3_4dcd_bdf5_bcdd6877aa69.slice/crio-d778fc36908604dcddd5a2fb3f27d31103f1e073a808a275b9b8e6767cbb3b81 WatchSource:0}: Error finding container d778fc36908604dcddd5a2fb3f27d31103f1e073a808a275b9b8e6767cbb3b81: Status 404 returned error can't find the container with id d778fc36908604dcddd5a2fb3f27d31103f1e073a808a275b9b8e6767cbb3b81 May 21 14:53:15.827369 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:15.827350 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:53:16.600626 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:16.600536 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" event={"ID":"e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69","Type":"ContainerStarted","Data":"4823e76a4060b12b8121f2320b80d8a1ab064a797dc8aa521b7c3ecabff6eafa"} May 21 14:53:16.600626 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:16.600580 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" event={"ID":"e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69","Type":"ContainerStarted","Data":"d778fc36908604dcddd5a2fb3f27d31103f1e073a808a275b9b8e6767cbb3b81"} May 21 14:53:16.600626 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:16.600598 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:53:16.626166 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:16.626115 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" podStartSLOduration=1.172367552 podStartE2EDuration="1.626098302s" podCreationTimestamp="2026-05-21 14:53:15 +0000 UTC" firstStartedPulling="2026-05-21 14:53:15.827533709 +0000 UTC m=+817.497783785" lastFinishedPulling="2026-05-21 14:53:16.281264463 +0000 UTC m=+817.951514535" observedRunningTime="2026-05-21 14:53:16.625240282 +0000 UTC m=+818.295490379" watchObservedRunningTime="2026-05-21 14:53:16.626098302 +0000 UTC m=+818.296348397" May 21 14:53:27.610228 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:53:27.610195 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbf5d79c-8g9js" May 21 14:54:38.863933 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:54:38.863861 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:54:38.865979 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:54:38.865954 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:59:38.889772 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:59:38.889747 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 14:59:38.892899 ip-10-0-131-210 kubenswrapper[2553]: I0521 14:59:38.892879 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:00:00.150127 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.150095 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656260-mjwcr"] May 21 15:00:00.153539 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.153522 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:00:00.155848 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.155831 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-92tkw\"" May 21 15:00:00.169233 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.169206 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656260-mjwcr"] May 21 15:00:00.214467 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.214435 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4nw\" (UniqueName: \"kubernetes.io/projected/f9216170-b4c0-4484-84b8-40a85fc4a3b3-kube-api-access-5f4nw\") pod \"maas-api-key-cleanup-29656260-mjwcr\" (UID: \"f9216170-b4c0-4484-84b8-40a85fc4a3b3\") " pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:00:00.315572 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.315522 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4nw\" (UniqueName: \"kubernetes.io/projected/f9216170-b4c0-4484-84b8-40a85fc4a3b3-kube-api-access-5f4nw\") pod \"maas-api-key-cleanup-29656260-mjwcr\" (UID: \"f9216170-b4c0-4484-84b8-40a85fc4a3b3\") " pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:00:00.326333 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.326304 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4nw\" (UniqueName: \"kubernetes.io/projected/f9216170-b4c0-4484-84b8-40a85fc4a3b3-kube-api-access-5f4nw\") pod \"maas-api-key-cleanup-29656260-mjwcr\" (UID: \"f9216170-b4c0-4484-84b8-40a85fc4a3b3\") " pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:00:00.464095 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.464013 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:00:00.595649 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.595624 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656260-mjwcr"] May 21 15:00:00.598081 ip-10-0-131-210 kubenswrapper[2553]: W0521 15:00:00.598057 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9216170_b4c0_4484_84b8_40a85fc4a3b3.slice/crio-3f2e64a724c3d78a552b9fffd89931f68facb41a55d03cf905d8476090b6109e WatchSource:0}: Error finding container 3f2e64a724c3d78a552b9fffd89931f68facb41a55d03cf905d8476090b6109e: Status 404 returned error can't find the container with id 3f2e64a724c3d78a552b9fffd89931f68facb41a55d03cf905d8476090b6109e May 21 15:00:00.600324 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.600303 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:00:00.948440 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:00.948405 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" event={"ID":"f9216170-b4c0-4484-84b8-40a85fc4a3b3","Type":"ContainerStarted","Data":"3f2e64a724c3d78a552b9fffd89931f68facb41a55d03cf905d8476090b6109e"} May 21 15:00:06.969024 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:06.968940 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" event={"ID":"f9216170-b4c0-4484-84b8-40a85fc4a3b3","Type":"ContainerStarted","Data":"e294b01090c1cfb276418afed25521ae55fe2a73f5de3460bf3a684f51f035e8"} May 21 15:00:06.997374 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:06.997315 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" podStartSLOduration=0.89764625 podStartE2EDuration="6.997300687s" podCreationTimestamp="2026-05-21 15:00:00 +0000 UTC" firstStartedPulling="2026-05-21 15:00:00.600548646 +0000 UTC m=+1222.270798737" lastFinishedPulling="2026-05-21 15:00:06.700203093 +0000 UTC m=+1228.370453174" observedRunningTime="2026-05-21 15:00:06.997207211 +0000 UTC m=+1228.667457308" watchObservedRunningTime="2026-05-21 15:00:06.997300687 +0000 UTC m=+1228.667550782" May 21 15:00:07.974023 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:07.973931 2553 generic.go:358] "Generic (PLEG): container finished" podID="f9216170-b4c0-4484-84b8-40a85fc4a3b3" containerID="e294b01090c1cfb276418afed25521ae55fe2a73f5de3460bf3a684f51f035e8" exitCode=0 May 21 15:00:07.974421 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:07.974013 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" event={"ID":"f9216170-b4c0-4484-84b8-40a85fc4a3b3","Type":"ContainerDied","Data":"e294b01090c1cfb276418afed25521ae55fe2a73f5de3460bf3a684f51f035e8"} May 21 15:00:09.104592 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.104559 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:00:09.203282 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.203246 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f4nw\" (UniqueName: \"kubernetes.io/projected/f9216170-b4c0-4484-84b8-40a85fc4a3b3-kube-api-access-5f4nw\") pod \"f9216170-b4c0-4484-84b8-40a85fc4a3b3\" (UID: \"f9216170-b4c0-4484-84b8-40a85fc4a3b3\") " May 21 15:00:09.205279 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.205246 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9216170-b4c0-4484-84b8-40a85fc4a3b3-kube-api-access-5f4nw" (OuterVolumeSpecName: "kube-api-access-5f4nw") pod "f9216170-b4c0-4484-84b8-40a85fc4a3b3" (UID: "f9216170-b4c0-4484-84b8-40a85fc4a3b3"). InnerVolumeSpecName "kube-api-access-5f4nw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:00:09.303903 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.303866 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f4nw\" (UniqueName: \"kubernetes.io/projected/f9216170-b4c0-4484-84b8-40a85fc4a3b3-kube-api-access-5f4nw\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 15:00:09.982144 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.982108 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" event={"ID":"f9216170-b4c0-4484-84b8-40a85fc4a3b3","Type":"ContainerDied","Data":"3f2e64a724c3d78a552b9fffd89931f68facb41a55d03cf905d8476090b6109e"} May 21 15:00:09.982144 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.982143 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f2e64a724c3d78a552b9fffd89931f68facb41a55d03cf905d8476090b6109e" May 21 15:00:09.982144 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:00:09.982143 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-mjwcr" May 21 15:04:38.914215 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:04:38.914185 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:04:38.918373 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:04:38.918348 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:09:38.940180 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:09:38.940151 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:09:38.945936 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:09:38.945906 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:14:38.967743 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:38.967715 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:14:38.975531 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:38.975507 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:14:39.611555 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:39.611522 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656260-mjwcr_f9216170-b4c0-4484-84b8-40a85fc4a3b3/cleanup/0.log" May 21 15:14:39.728827 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:39.728794 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58cbf5d79c-8g9js_e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69/manager/0.log" May 21 15:14:40.190080 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:40.190055 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bf5b4865-vwsrv_966c4ec9-e164-4b93-825a-bf061cf6b6bb/manager/0.log" May 21 15:14:40.300063 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:40.300029 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-xx2dv_85897035-30ea-4145-a43b-9a6f7c6dec7e/postgres/0.log" May 21 15:14:41.974737 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:41.974710 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-45f5w_4b4c1ed0-6df1-4395-9545-1f54027a14f7/kuadrant-console-plugin/0.log" May 21 15:14:43.076699 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:43.076666 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f98856cd9-bt5jp_9a162daa-4432-475a-9299-a4bd0175baca/kube-auth-proxy/0.log" May 21 15:14:43.546601 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:43.546569 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-776bfd778d-47ksc_f62ca4a3-ffac-4fb8-a123-a2e513279dd7/router/0.log" May 21 15:14:44.145596 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:44.145562 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-ms4nb_f3aba338-58c7-49af-bae3-e1d6399b5fe3/storage-initializer/0.log" May 21 15:14:44.152783 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:44.152763 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-ms4nb_f3aba338-58c7-49af-bae3-e1d6399b5fe3/main/0.log" May 21 15:14:48.309040 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.309005 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44c74/must-gather-6rdqv"] May 21 15:14:48.309419 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.309400 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9216170-b4c0-4484-84b8-40a85fc4a3b3" containerName="cleanup" May 21 15:14:48.309419 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.309412 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9216170-b4c0-4484-84b8-40a85fc4a3b3" containerName="cleanup" May 21 15:14:48.309516 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.309479 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9216170-b4c0-4484-84b8-40a85fc4a3b3" containerName="cleanup" May 21 15:14:48.312625 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.312610 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.314940 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.314916 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44c74\"/\"openshift-service-ca.crt\"" May 21 15:14:48.315188 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.315173 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44c74\"/\"default-dockercfg-nfw54\"" May 21 15:14:48.315900 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.315884 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44c74\"/\"kube-root-ca.crt\"" May 21 15:14:48.329664 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.329638 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44c74/must-gather-6rdqv"] May 21 15:14:48.487930 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.487894 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twqx\" (UniqueName: \"kubernetes.io/projected/8457dad3-e03b-449e-bfb7-7b53461167f9-kube-api-access-5twqx\") pod \"must-gather-6rdqv\" (UID: \"8457dad3-e03b-449e-bfb7-7b53461167f9\") " pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.488143 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.488004 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8457dad3-e03b-449e-bfb7-7b53461167f9-must-gather-output\") pod \"must-gather-6rdqv\" (UID: \"8457dad3-e03b-449e-bfb7-7b53461167f9\") " pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.588843 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.588735 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5twqx\" (UniqueName: \"kubernetes.io/projected/8457dad3-e03b-449e-bfb7-7b53461167f9-kube-api-access-5twqx\") pod \"must-gather-6rdqv\" (UID: \"8457dad3-e03b-449e-bfb7-7b53461167f9\") " pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.588843 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.588840 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8457dad3-e03b-449e-bfb7-7b53461167f9-must-gather-output\") pod \"must-gather-6rdqv\" (UID: \"8457dad3-e03b-449e-bfb7-7b53461167f9\") " pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.589167 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.589151 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8457dad3-e03b-449e-bfb7-7b53461167f9-must-gather-output\") pod \"must-gather-6rdqv\" (UID: \"8457dad3-e03b-449e-bfb7-7b53461167f9\") " pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.597584 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.597562 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twqx\" (UniqueName: \"kubernetes.io/projected/8457dad3-e03b-449e-bfb7-7b53461167f9-kube-api-access-5twqx\") pod \"must-gather-6rdqv\" (UID: \"8457dad3-e03b-449e-bfb7-7b53461167f9\") " pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.621600 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.621577 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44c74/must-gather-6rdqv" May 21 15:14:48.745244 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.745221 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44c74/must-gather-6rdqv"] May 21 15:14:48.747479 ip-10-0-131-210 kubenswrapper[2553]: W0521 15:14:48.747454 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8457dad3_e03b_449e_bfb7_7b53461167f9.slice/crio-e4b9b2fc6811d30298bbdf0df658194ff42ce763d0ebd4f7a7b9f1df7992a5e8 WatchSource:0}: Error finding container e4b9b2fc6811d30298bbdf0df658194ff42ce763d0ebd4f7a7b9f1df7992a5e8: Status 404 returned error can't find the container with id e4b9b2fc6811d30298bbdf0df658194ff42ce763d0ebd4f7a7b9f1df7992a5e8 May 21 15:14:48.749263 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.749243 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:14:48.969590 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:48.969503 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44c74/must-gather-6rdqv" event={"ID":"8457dad3-e03b-449e-bfb7-7b53461167f9","Type":"ContainerStarted","Data":"e4b9b2fc6811d30298bbdf0df658194ff42ce763d0ebd4f7a7b9f1df7992a5e8"} May 21 15:14:49.975558 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:49.975522 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44c74/must-gather-6rdqv" event={"ID":"8457dad3-e03b-449e-bfb7-7b53461167f9","Type":"ContainerStarted","Data":"acd6b61275e53f966542f7a6175998d9c966f0d9d493b35a1c005849f3e901f2"} May 21 15:14:50.980264 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:50.980229 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44c74/must-gather-6rdqv" event={"ID":"8457dad3-e03b-449e-bfb7-7b53461167f9","Type":"ContainerStarted","Data":"731cb973995519227745bdb8fbdbfcabcffa5e0bd670744385b99480ada4a081"} May 21 15:14:50.996319 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:50.996260 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-44c74/must-gather-6rdqv" podStartSLOduration=1.961733111 podStartE2EDuration="2.996246473s" podCreationTimestamp="2026-05-21 15:14:48 +0000 UTC" firstStartedPulling="2026-05-21 15:14:48.749378954 +0000 UTC m=+2110.419629027" lastFinishedPulling="2026-05-21 15:14:49.783892313 +0000 UTC m=+2111.454142389" observedRunningTime="2026-05-21 15:14:50.995566568 +0000 UTC m=+2112.665816663" watchObservedRunningTime="2026-05-21 15:14:50.996246473 +0000 UTC m=+2112.666496568" May 21 15:14:51.436938 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:51.436907 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mmt24_dbeb68c7-5f43-45f6-b6d2-a9dd18317e4b/global-pull-secret-syncer/0.log" May 21 15:14:51.573987 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:51.573952 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d4l5l_05787355-21a8-4995-9797-6fdd8d075ee7/konnectivity-agent/0.log" May 21 15:14:51.626066 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:51.626034 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-210.ec2.internal_93d5251cf7952b6ea18709da9aad2938/haproxy/0.log" May 21 15:14:56.390698 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:56.390448 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-45f5w_4b4c1ed0-6df1-4395-9545-1f54027a14f7/kuadrant-console-plugin/0.log" May 21 15:14:58.116757 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.116729 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/alertmanager/0.log" May 21 15:14:58.138513 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.138399 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/config-reloader/0.log" May 21 15:14:58.160401 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.160339 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/kube-rbac-proxy-web/0.log" May 21 15:14:58.181787 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.181722 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/kube-rbac-proxy/0.log" May 21 15:14:58.204413 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.204387 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/kube-rbac-proxy-metric/0.log" May 21 15:14:58.230768 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.230737 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/prom-label-proxy/0.log" May 21 15:14:58.254443 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.254413 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09e207c4-0b80-4571-848f-b7bb5d329db3/init-config-reloader/0.log" May 21 15:14:58.319128 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.319095 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vqghl_5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d/kube-state-metrics/0.log" May 21 15:14:58.340454 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.340413 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vqghl_5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d/kube-rbac-proxy-main/0.log" May 21 15:14:58.363026 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.362984 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vqghl_5fe8e8cb-2ad7-46dd-a90e-7fb30a8bda5d/kube-rbac-proxy-self/0.log" May 21 15:14:58.456868 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.456791 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bx2rw_0fdedf19-27f4-4145-8622-4bcfaf953944/node-exporter/0.log" May 21 15:14:58.487369 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.487335 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bx2rw_0fdedf19-27f4-4145-8622-4bcfaf953944/kube-rbac-proxy/0.log" May 21 15:14:58.507858 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.507827 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bx2rw_0fdedf19-27f4-4145-8622-4bcfaf953944/init-textfile/0.log" May 21 15:14:58.758600 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.758574 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/prometheus/0.log" May 21 15:14:58.780651 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.780625 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/config-reloader/0.log" May 21 15:14:58.803900 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.803872 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/thanos-sidecar/0.log" May 21 15:14:58.824599 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.824577 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/kube-rbac-proxy-web/0.log" May 21 15:14:58.848613 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.848590 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/kube-rbac-proxy/0.log" May 21 15:14:58.871849 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.871820 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/kube-rbac-proxy-thanos/0.log" May 21 15:14:58.906157 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.906131 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8832b9b0-0454-43ba-9243-26db94f06a28/init-config-reloader/0.log" May 21 15:14:58.935402 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.935372 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-2vrxp_db09b25a-5e0d-4da4-bb8e-47963e2a1993/prometheus-operator/0.log" May 21 15:14:58.956823 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.956792 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-2vrxp_db09b25a-5e0d-4da4-bb8e-47963e2a1993/kube-rbac-proxy/0.log" May 21 15:14:58.979247 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:58.979225 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-g8wp7_90901083-e78b-4310-99f1-5f7f6e66e940/prometheus-operator-admission-webhook/0.log" May 21 15:14:59.094989 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.094911 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f5bd569f8-q88g8_a6780de4-81d6-43b7-918e-e6cad6d1ca11/thanos-query/0.log" May 21 15:14:59.116376 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.116353 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f5bd569f8-q88g8_a6780de4-81d6-43b7-918e-e6cad6d1ca11/kube-rbac-proxy-web/0.log" May 21 15:14:59.137866 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.137838 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f5bd569f8-q88g8_a6780de4-81d6-43b7-918e-e6cad6d1ca11/kube-rbac-proxy/0.log" May 21 15:14:59.159808 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.159786 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f5bd569f8-q88g8_a6780de4-81d6-43b7-918e-e6cad6d1ca11/prom-label-proxy/0.log" May 21 15:14:59.181878 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.181857 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f5bd569f8-q88g8_a6780de4-81d6-43b7-918e-e6cad6d1ca11/kube-rbac-proxy-rules/0.log" May 21 15:14:59.203594 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.203566 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f5bd569f8-q88g8_a6780de4-81d6-43b7-918e-e6cad6d1ca11/kube-rbac-proxy-metrics/0.log" May 21 15:14:59.777994 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.777951 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9"] May 21 15:14:59.783122 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.783093 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.791763 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.791729 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9"] May 21 15:14:59.821995 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.821946 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-lib-modules\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.822165 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.822078 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-proc\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.822165 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.822100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-podres\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.822165 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.822135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-sys\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.822326 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.822177 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lbbk\" (UniqueName: \"kubernetes.io/projected/cc3e2e34-5742-49bc-857b-1ef8933855f7-kube-api-access-5lbbk\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923142 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923109 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-proc\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923142 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923143 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-podres\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923168 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-sys\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923203 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lbbk\" (UniqueName: \"kubernetes.io/projected/cc3e2e34-5742-49bc-857b-1ef8933855f7-kube-api-access-5lbbk\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923250 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-proc\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923301 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-podres\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923316 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-sys\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923256 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-lib-modules\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.923382 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.923333 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc3e2e34-5742-49bc-857b-1ef8933855f7-lib-modules\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:14:59.932943 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:14:59.932918 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lbbk\" (UniqueName: \"kubernetes.io/projected/cc3e2e34-5742-49bc-857b-1ef8933855f7-kube-api-access-5lbbk\") pod \"perf-node-gather-daemonset-tkdb9\" (UID: \"cc3e2e34-5742-49bc-857b-1ef8933855f7\") " pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:15:00.096863 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.096767 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:15:00.166225 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.166118 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656275-f2c9d"] May 21 15:15:00.175300 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.175278 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:00.178821 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.178797 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-92tkw\"" May 21 15:15:00.181120 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.181080 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656275-f2c9d"] May 21 15:15:00.226429 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.225995 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvv46\" (UniqueName: \"kubernetes.io/projected/d9be5401-1766-4c71-a009-6ed33762ef00-kube-api-access-cvv46\") pod \"maas-api-key-cleanup-29656275-f2c9d\" (UID: \"d9be5401-1766-4c71-a009-6ed33762ef00\") " pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:00.278449 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.278420 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9"] May 21 15:15:00.280918 ip-10-0-131-210 kubenswrapper[2553]: W0521 15:15:00.280880 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc3e2e34_5742_49bc_857b_1ef8933855f7.slice/crio-aa9f52bf5441d13b51ca5dd890722635197560f32020ca714586778e3713289f WatchSource:0}: Error finding container aa9f52bf5441d13b51ca5dd890722635197560f32020ca714586778e3713289f: Status 404 returned error can't find the container with id aa9f52bf5441d13b51ca5dd890722635197560f32020ca714586778e3713289f May 21 15:15:00.327279 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.327253 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvv46\" (UniqueName: \"kubernetes.io/projected/d9be5401-1766-4c71-a009-6ed33762ef00-kube-api-access-cvv46\") pod \"maas-api-key-cleanup-29656275-f2c9d\" (UID: \"d9be5401-1766-4c71-a009-6ed33762ef00\") " pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:00.339687 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.339287 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvv46\" (UniqueName: \"kubernetes.io/projected/d9be5401-1766-4c71-a009-6ed33762ef00-kube-api-access-cvv46\") pod \"maas-api-key-cleanup-29656275-f2c9d\" (UID: \"d9be5401-1766-4c71-a009-6ed33762ef00\") " pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:00.490313 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.490281 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:00.653579 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.651813 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656275-f2c9d"] May 21 15:15:00.658331 ip-10-0-131-210 kubenswrapper[2553]: W0521 15:15:00.658291 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9be5401_1766_4c71_a009_6ed33762ef00.slice/crio-9ddcd3eac24619ab8af1772a3abb8c290a553908b795ab9c5cac03145063c0a9 WatchSource:0}: Error finding container 9ddcd3eac24619ab8af1772a3abb8c290a553908b795ab9c5cac03145063c0a9: Status 404 returned error can't find the container with id 9ddcd3eac24619ab8af1772a3abb8c290a553908b795ab9c5cac03145063c0a9 May 21 15:15:00.843603 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.839772 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/1.log" May 21 15:15:00.845847 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:00.845825 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pkljv_9e4d8051-9b47-443d-ac67-0fa1cae53c61/console-operator/2.log" May 21 15:15:01.040726 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.040466 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" event={"ID":"d9be5401-1766-4c71-a009-6ed33762ef00","Type":"ContainerStarted","Data":"604feb350d6113d1713d0408cb15c4ba4ca38feac6d67e4d8c4ef3a717063f0c"} May 21 15:15:01.040726 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.040526 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" event={"ID":"d9be5401-1766-4c71-a009-6ed33762ef00","Type":"ContainerStarted","Data":"9ddcd3eac24619ab8af1772a3abb8c290a553908b795ab9c5cac03145063c0a9"} May 21 15:15:01.042082 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.042049 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" event={"ID":"cc3e2e34-5742-49bc-857b-1ef8933855f7","Type":"ContainerStarted","Data":"57b5f00717acbfa2af52386c2faa4130b4b7e24a6456ec2342d114a01b69d103"} May 21 15:15:01.042082 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.042083 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" event={"ID":"cc3e2e34-5742-49bc-857b-1ef8933855f7","Type":"ContainerStarted","Data":"aa9f52bf5441d13b51ca5dd890722635197560f32020ca714586778e3713289f"} May 21 15:15:01.042542 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.042511 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:15:01.058215 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.058162 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" podStartSLOduration=1.058141765 podStartE2EDuration="1.058141765s" podCreationTimestamp="2026-05-21 15:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:15:01.0561544 +0000 UTC m=+2122.726404497" watchObservedRunningTime="2026-05-21 15:15:01.058141765 +0000 UTC m=+2122.728391864" May 21 15:15:01.072625 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.072577 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" podStartSLOduration=2.072560105 podStartE2EDuration="2.072560105s" podCreationTimestamp="2026-05-21 15:14:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:15:01.071990552 +0000 UTC m=+2122.742240653" watchObservedRunningTime="2026-05-21 15:15:01.072560105 +0000 UTC m=+2122.742810201" May 21 15:15:01.810514 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:01.810469 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-p97bb_6fea1369-3959-4288-ad94-889c651bc285/volume-data-source-validator/0.log" May 21 15:15:02.047175 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:02.047131 2553 generic.go:358] "Generic (PLEG): container finished" podID="d9be5401-1766-4c71-a009-6ed33762ef00" containerID="604feb350d6113d1713d0408cb15c4ba4ca38feac6d67e4d8c4ef3a717063f0c" exitCode=0 May 21 15:15:02.047575 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:02.047540 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" event={"ID":"d9be5401-1766-4c71-a009-6ed33762ef00","Type":"ContainerDied","Data":"604feb350d6113d1713d0408cb15c4ba4ca38feac6d67e4d8c4ef3a717063f0c"} May 21 15:15:02.591695 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:02.591657 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7qrnt_b2ddd360-2983-47bf-89d1-2164226fcc32/dns/0.log" May 21 15:15:02.614205 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:02.614175 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7qrnt_b2ddd360-2983-47bf-89d1-2164226fcc32/kube-rbac-proxy/0.log" May 21 15:15:02.683865 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:02.683839 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7sqdr_da333afb-a4e4-4356-abd5-02bbcf4c207c/dns-node-resolver/0.log" May 21 15:15:03.211690 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:03.211576 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:03.259035 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:03.259006 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvv46\" (UniqueName: \"kubernetes.io/projected/d9be5401-1766-4c71-a009-6ed33762ef00-kube-api-access-cvv46\") pod \"d9be5401-1766-4c71-a009-6ed33762ef00\" (UID: \"d9be5401-1766-4c71-a009-6ed33762ef00\") " May 21 15:15:03.261165 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:03.261140 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9be5401-1766-4c71-a009-6ed33762ef00-kube-api-access-cvv46" (OuterVolumeSpecName: "kube-api-access-cvv46") pod "d9be5401-1766-4c71-a009-6ed33762ef00" (UID: "d9be5401-1766-4c71-a009-6ed33762ef00"). InnerVolumeSpecName "kube-api-access-cvv46". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:15:03.290444 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:03.290422 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j9bjz_c275336e-90a5-4db0-bd89-976e0a057107/node-ca/0.log" May 21 15:15:03.359945 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:03.359848 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvv46\" (UniqueName: \"kubernetes.io/projected/d9be5401-1766-4c71-a009-6ed33762ef00-kube-api-access-cvv46\") on node \"ip-10-0-131-210.ec2.internal\" DevicePath \"\"" May 21 15:15:04.055525 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:04.055476 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" event={"ID":"d9be5401-1766-4c71-a009-6ed33762ef00","Type":"ContainerDied","Data":"9ddcd3eac24619ab8af1772a3abb8c290a553908b795ab9c5cac03145063c0a9"} May 21 15:15:04.055742 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:04.055724 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ddcd3eac24619ab8af1772a3abb8c290a553908b795ab9c5cac03145063c0a9" May 21 15:15:04.055968 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:04.055953 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656275-f2c9d" May 21 15:15:04.287856 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:04.287825 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f98856cd9-bt5jp_9a162daa-4432-475a-9299-a4bd0175baca/kube-auth-proxy/0.log" May 21 15:15:04.515351 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:04.515326 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-776bfd778d-47ksc_f62ca4a3-ffac-4fb8-a123-a2e513279dd7/router/0.log" May 21 15:15:05.028146 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:05.028120 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmq5c_f8d98097-5c36-4d83-a6f2-3b6e4242b4e5/serve-healthcheck-canary/0.log" May 21 15:15:05.683788 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:05.683757 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8gzj_f4e49e22-5aa1-49ca-a23c-c3f8eed39830/kube-rbac-proxy/0.log" May 21 15:15:05.704698 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:05.704664 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8gzj_f4e49e22-5aa1-49ca-a23c-c3f8eed39830/exporter/0.log" May 21 15:15:05.726902 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:05.726876 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8gzj_f4e49e22-5aa1-49ca-a23c-c3f8eed39830/extractor/0.log" May 21 15:15:07.057583 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:07.057541 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44c74/perf-node-gather-daemonset-tkdb9" May 21 15:15:07.685003 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:07.684973 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656260-mjwcr_f9216170-b4c0-4484-84b8-40a85fc4a3b3/cleanup/0.log" May 21 15:15:07.710033 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:07.710010 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656275-f2c9d_d9be5401-1766-4c71-a009-6ed33762ef00/cleanup/0.log" May 21 15:15:07.799067 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:07.799011 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58cbf5d79c-8g9js_e4bf13eb-36e3-4dcd-bdf5-bcdd6877aa69/manager/0.log" May 21 15:15:07.939137 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:07.939048 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bf5b4865-vwsrv_966c4ec9-e164-4b93-825a-bf061cf6b6bb/manager/0.log" May 21 15:15:07.969116 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:07.969069 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-xx2dv_85897035-30ea-4145-a43b-9a6f7c6dec7e/postgres/0.log" May 21 15:15:09.325227 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:09.325121 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78587c7698-vmnxk_24a64eab-57d5-466e-ae44-dbc3d3bd46c4/manager/0.log" May 21 15:15:15.478167 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.478140 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/kube-multus-additional-cni-plugins/0.log" May 21 15:15:15.500743 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.500718 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/egress-router-binary-copy/0.log" May 21 15:15:15.525394 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.525369 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/cni-plugins/0.log" May 21 15:15:15.549077 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.549041 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/bond-cni-plugin/0.log" May 21 15:15:15.571353 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.571325 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/routeoverride-cni/0.log" May 21 15:15:15.592979 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.592947 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/whereabouts-cni-bincopy/0.log" May 21 15:15:15.614515 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.614423 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7dff_4a088b46-ed97-484c-b3be-575bef0b2c3e/whereabouts-cni/0.log" May 21 15:15:15.674203 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.674176 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w2ls9_ca100150-ad19-437a-a6b9-c630ae06fde3/kube-multus/0.log" May 21 15:15:15.692826 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.692794 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lsrm_f0ff1ed8-1a76-4f9f-a243-8a159873b6ab/network-metrics-daemon/0.log" May 21 15:15:15.717656 ip-10-0-131-210 kubenswrapper[2553]: I0521 15:15:15.717622 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lsrm_f0ff1ed8-1a76-4f9f-a243-8a159873b6ab/kube-rbac-proxy/0.log"